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Introduction 



In this paper, we begin the study of poles of partial L-functions 
L^{a ® T,s), where a (8) t is an irreducible, automorphic, cuspidal, generic 
(i.e. with nontrivial Whittaker coefficient) representation of Ga x GL,„(A). 
G is a split classical group and A is the adele ring of a number field F. We 
also consider Sp2„(A) x GLm(A), where ~ denotes the metaplectic cover. 

Examining L^{a ^ r, s) through the corresponding Rankin-Selberg, or 
^ ; Shimura-type integrals ([G-PS-R], [G-R-S3], [G], [So]), we find that the global 
' integral contains, in its integrand, a certain normalized Eisenstein series which 
is responsible for the poles. For example, if G = S02fc+i, then the Eisenstein 
series is on the adele points of split S02m, induced from the Siegel parabolic 

^ . subgroup and r (g) |det-|*~^/^. If G = Sp2fc (this is a convenient abuse of 
T^lj- [ notation), then the Eisenstein series is on Sp2m(A), induced from the Siegel 
' parabolic subgroup and r \ det ■\'^~^^'^. The constant term (along the "Siegel 
. radical" ) of such a normalized Eisenstein series involves one of the L-functions 
y—i , [t, A? ,2s — 1) or L'^(r, Sym^, 2s — 1). So, up to problems of normalization 
^ \ of intertwining operators, the only pole we expect, for Re(s) > 1/2, is at s = 1 
and then r should be self-dual. (See [J-Sl], [B-G].) Thus, let us assume that 
T is self-dual. By [J-Sl], we know that L^{t (E> t, s) has a simple pole at s = 1. 
^ \ Since 

- (0.1) L^(r®T,s) = L^(T,A2,s)L^(r,Sym2,s) 

and since each factor is nonzero at s = 1, it follows that exactly one of the 
■ L-functions L'^(r, A^,s) and L'^(t, Sym^, s) has a simple pole at s = 1. We 
9^ . recall that if m is odd, then L'^(r, A^,s) is entire ([J-Sl]). 

Assume, for example, that m = 2n and L'^(t, A^,s) has a pole at s = 1. 
Then the above-mentioned Eisenstein series (denote it, for this introduction, 
by Er^s{h)) on S04„(A) has a simple pole at s = 1. (See Proposition 1 and Re- 
mark 2.) Let G = S02A:+i and a be as above. Langlands conjectures, predict 
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the existence of a functorial lift of a, denote it tt, on GL2fc(A). vr is an irre- 
ducible automorphic representation of GL2fc(A). In particular, {a iSi r, s) = 
L^{tt ^ T, s). Thus, if A; < n, L^{a (8) t, s) should be holomorphic at s = 1. 
Similarly, if L'^(r, A^,.s) has a pole at s = 1, (m = 2n), and L'^ {t, st, 1/2) 
7^ 0, (partial standard L- function) then the above-mentioned Eisenstein series 
(denote it by ET^s{h)) on Sp4„(A) has a simple pole at s = 1 (see Proposi- 
tion 1). Let G = Sp2k ^-^d a as above. Again, one expects the existence of 
a "functorial lift" of a, denote it tt, on GL2fc(A) (such a lift is not canonic, 
it depends on a choice of a nontrivial character of F\A). One of our main 
results (Theorem 14) states 

Theorem A. Leta(^T he an irreducible, automorphic, cuspidal, generic 
representation of Sp2k{A) x GL2n(A), such that 1 < k < n. Assume that 

(0.2) L^{T,st,l/2)^0 

and 

L^{t, , s) has a pole at s = 1 . 
Then {a (8) r, s) is holomorphic at s = 1. 

The definition of the partial standard L-function of a r depends on a 
choice of ip; see [G-R-S3]. The proof of the theorem involves new ideas and 
results which we regard as the main contribution of this work. 

In general terms, we actually construct a candidate a = ct{t) = o"^(r), 
on Sp2„(A), which should lift functorially to r. Moreover, <j(r) fits into a 
fascinating "tower" of automorphic cuspidal modules (Tfc(r) of Sp2jt(A), < 
A; < 2n — 1. (Define Spq(A) = {!}.) The "tower property" is the same as in 
the theory of theta series liftings of dual pairs [R-] . Thus, for the first index 
such that (y^^ir) is nontrivial, (Ji^ij) is cuspidal, and for higher indices, (Tjt(r) 
is noncuspidal. 

Let us give some more details. We first consider the example where cr is a 
generic representation of S02fe+i(A) and r is on GL2„(A), such that L^{t, ^?,s) 
has a pole at s = L The Rankin-Selberg integral for L^{u®t, s), when k < 2n, 
has the form 

(0-3) J ^{g)Ef^Md9 

S02fc+i(F)\S02fc+i(A) 

where Ef^g is a certain Fourier coefficient of the Eisenstein series (on S04„(A)) 
along some unipotent subgroup Nk of S04„, and with respect to a character tpk 

of Nk{F)\Nk{A), stabilized by S02A;+i(A), for some corresponding embedding 
of S02jk+i inside S04„. (p is a cusp form in the space of a. The integral (0.3), 
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in case k = n, suggests that if L^{a ^ r, s) has a pole at s = 1, then a pairs 
with the representation cr(r), of S02n+i(A), on the space spanned by 



Res5=i£^T-5(/i) 



SO2 



Now, when we try to compute the various constant terms of o"(t) along the 
unipotent radicals of parabolic subgroups of S02n+i5 we find out that these 
are expressed in terms of 



Ress=i Er,sih) 



so 



2^+11, 



for I < n. This immediately reveals the tower property. Indeed, wc define 
for any < fc < 2n, the representation (Tfc(r) of S02fc+i(A), acting by right 
translations on the space of 

■<Pk 



This leads us to another main result of this paper. 

Theorem B. Let r be an irreducible, automorphic, cuspidal represen- 
tation 0/ GL2n(A). Assume that L'^(t, A^,s) has a pole at s = 1. Then the 
representations {o'fc(r)}|"Q^ have the tower property, i.e. for the first index £n, 
such that cre^{T) 7^ 0, c7i^{t) is cuspidal and for k > £„, crk{T) is noncuspidal. 

It is easy to see that 1 < < 2n — 1 and that ae^ (r) is generic. Our main 
conjecture for this case is 

Conjecture. 

1) in = n. 

2) cr„(r) is irreducible and lifts functorially from S02n+i(A) to r. 

Remark. The conjecture implies that crn(r) is a generic member of the 
L-packet which lifts to r. 

We define similar towers, prove Theorem B and state the above conjecture 
in case conditions (0.2) hold, and also in case L'^(r, Sym^, s) has a pole at 
s = 1 (so here r is on GL2n(A) or on GL2n+i(A)). In each case, we use a 
corresponding global integral. For example, if conditions (0.2) hold, then the 
global integral is of Shimura type, and we construct the representations (7fc(r) 
of Sp2fe(A) using a sequence of Fourier- Jacobi coefficients of Res5=i £'r,s(^) (the 
Eisenstein series is on Sp4„(A)). In this case, we make one step towards the 
conjecture and prove 
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Theorem C. Let r be an irreducible, automorphic, cuspidal representa- 
tion o/GL2n(A), such that L^{t,A'^,s) has a pole at s = 1 and L^{T,st, 1/2) 
0. Then 

Cfe (''")= , for k < n ; 

that is £„> n. 

The proof of Theorem C is based on the fohowing two key observations. 
The first is 

Theorem D. Under the assumptions of Theorem C, Ress=i -Er,s(/i) has 
a nontrivial period along the subgroup Sp2„(A) xSp2„(A) (direct sum embedding 
in Sp4„(A)). 

The second observation is that for an irreducible, admissible representa- 
tion of Sp4„(F), where F is p-adic, the existence of (nontrivial) Sp2„(-F) x 
Sp2„(-F) invariant functionals negates the existence of the Fourier- Jacobi mod- 
els which enter the definition of (r) , provided k < n. 

Note added in proof. Since the time of writing this paper, we have proved 
large parts of the above conjecture. We can now prove that in = n in all 
four cases dealt with here. Thus, for r as above, o"n(r) is a nonzero cuspidal 
module on Ga {G = Sp2„, S02n+i) S02n) Sp2„ respectively). The proof for 
G = Sp2„ appears in [G-R-S5], where we also give the analogous local theory, 
and construct for an irreducible supercuspidal, self-dual representation r of 
GL2n(^), k - a p-adic field, such that its local exterior square L- function has 
a pole at s = 0, an irreducible, supercuspidal, generic (with respect to a 
prechosen character ip) representation a = a^{T), such that 7(0" (8> r, s, tp) has 
a pole at s = 1. 7((T(8)r, s, ip) is the local gamma factor attached to cr(g)r, by the 
theory of Shimura type integrals considered here. In case G — Sp2y2 5 we prove 
in [G-R-S6] that each irreducible summand of crn{T) has indeed the unramified 
parameters determined by r, at almost all places (once we fix ip). Moreover, 
crn(r) is the direct sum of all irreducible, cuspidal, Vj-generic representations 
of Sp2„(A), which tp-liit to r. Thus, if wc have the irreducibility of (7„(t), 
which is part of the above conjecture, then (T„(r) will be the unique, ^-generic 
member of the "^/'--Z^-packet determined by r." The proof of the unramified 
correspondence and of the fact that = n in the remaining cases will appear 
in a paper which is now in preparation. 

The results of this paper and those just mentioned were announced in 
[G-R-S2]; see also [G-R-Sl]. 



EXPLICIT LIFTS OF CUSP FORMS 



811 



Finally, this paper is organized as follows. In Section 1, we prove Theo- 
rem D. In Section 2 we define the towers of representations crfe(r) and prove 
Theorem B for all cases (S02fc+i, Sp2;fc, S02fc, Sp2fe)- In Section 3 we prove 
Theorem C. Theorem A then follows corollary. 

Acknowledgement. We thank Jim Cogdell for helpful discussions and for 
his interest. 



1. Sp2„ X Sp2„ — Periods of residues of Eisenstein series 

1. The Eisenstein series of study and its pole at s = 1. Let G = Sp4„, 
considered as an algebraic group defined over a number field F. Let P = MU 
be the Siegel parabolic subgroup of G. Consider an irreducible, automorphic, 

cuspidal representation r of GL2n(A). Assume it is self-dual. Regard r as 

G 

a representation of Ma as well. Let (f) be an element of Indp-*^ r; i.e. ^ is a 
smooth function on Ga, taking values in the space of r, such t^at 

(f){mug;r) = 5p'^ {m)4>{g',rm) , 

for m G Ma, u e Ua, g & Ga, r G GL2n(A). We realize as a complex 
function on Ga x GL2n(A), such that r <—>■ ^{g; r) is a cusp form in the space of 
r. Assume that (p is right i^'-finite, where K is the standard maximal compact 
subgroup of Ga- Let, for s G C, 

ift^.ig; m) = H{gy-^/^<P{g; m) , 5 G Ga, m e GL2„(A) 

where if the Iwasawa decomposition of g is auk, a G GL2n(A), u G Ua, k E K, 
then H{g) = \ deta|. Now consider the corresponding Eisenstein series 

jePF\GF 

The series converges absolutely for Re(s) > n + 1, and admits a meromorphic 
continuation to the whole plane. It has a finite number of poles in the half- 
plane Re(s) > I and they are all simple [M-W, IV. 1.11]. Consider the constant 
term along U, 

(1-1) E^i9Jt,s)= J E{ug,jl,)du 

Uf\Ua 

= fUg) + M{s)fU9) , 
where M(s) is the intertwining operator, given, for Re(s) > n -|- 1, by the 
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convergent integral 

M{s)fls{9) = I fU^-'ug)du , 

for It; = ( I . Later on, it will be convenient to consider the inter- 

twining operator as evaluation at m = 1 of 

Mis){vt,,)ig;m)= j ipt^,{w-\g;m)du 

Uf\Uj^ 

which converges for Rc(s) > n + 1. These operators are decomposable in the 
following sense. Fix realizations of the local representations t^, and fix an 
isomorphism £ : (g)^-^ — > V-r, where V-r is the space of r. Now write <p{g){x) 
instead of (j){g;x), for g G Ga, a; G GL2„(A), so that (f){g) € Vr- For each 
place z^, let (p^, be an element of Indp" Tj^, such that for almost all u, (pi, = (ff^ 
unramified and 0^(1) = - a prechoscn unramified vector in Vr^. Assume 
that corresponds to ®4>v, that is <i{®<Pv{gv)) = (pid)- For such 0, we have, 

(1.2) M{s)ff^,{g) = ^(®M,(s)v.t,.(5.))(l) , 

where 

= Hig^y-'/'Ma.) 

and My(s) is the vector- valued intertwining operator that is the meromorphic 
continuation of the absolutely convergent integral given, for Re(s) > n + 1, by 

M,is)4;:^M = J 4:^,{w-^ug,)du . 
It is well known that for (pj^ = 4>1 

(13) MfsW'^" _ L(T.,8t,8-^)L(r.,A^2g-l) ^_^o 

(Recall that r = r.) The factors in (1.3) are respectively the standard and the 
exterior square local L-functions attached to T,y. Let 5 be a finite set of places 
outside which (p^^ = (p^ and g^ G Kjj-lhe standard maximal compact subgroup 
of Gu. Then in (1.2) 



:i.4) 

L^{t, St, s - ^)L^iT, A2, 2s - 1) 
T 

2 

where = 0.^5^°- 
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Proposition 1. Let S he a finite set of places, including those at 
infinity, outside which t,^ is unramified. Assume that L^{t, st, ^) and 
L^{t, A^, s) has a pole {simple) at s = 1. Then the Eisenstein series E{g, ff^g) 
has a pole {simple) at s = 1. 

Proof. It is enough to show that the constant term E^{g, ff^s) has a pole 
at s = 1, and, by (1.1), it is enough to show this for M{s)ff,s{g)- The 
L- functions {t, st, s + ^) and L{t, A^, 2s), are holomorphic at s = 1. (Actu- 
ally L^{t, st,s + ^) and L^{t, A^, 2s) are nonzero at s = 1. Indeed, form [J-S2, 
Th. 5.3], L^{T,st,z) is nonzero for Re(2;) > 1. This is also true, by the same 
theorem, for L^{t x t, z) = {t, h? , z)L^ {T,sym^ , z). From [J-Sl] and [B-G], 
L^{t, A^, z) and L'^{t, sym^, z) arc holomorphic at 2; = 2, and since their prod- 
uct is nonzero at z = 2, it follows that each of these L- function is holomorphic 
and nonzero at ^; = 2.) Thus, (1.4) will produce a pole of M{s)ff^s{g) at s = 1, 
provided we can choose data such that l{^i,^s^v{s)^t",s{gv)®{^^)^^{^) is 
nonzero at s = 1. The last expression is holomorphic at a neighbourhood of 
s = 1, since otherwise (1.4) will produce a high-order pole for M{s)ff,s{g), and 
this implies that E{g,ff^s) has a high-order pole at s = 1, contradicting the 
simplicity of the poles of E{g,ff^s), for Re(s) > 1/2. It is enough to consider 
g = 1. Let u e S he finite. Choose to have compact support, modulo P^, in 
the open cell Pi,w~^Uy, and such that the function on Uy, u ^ (j)y{w^^u) is the 
characteristic function of a small neighbourhood in U^, of 1. Choose ^i, G V-,-^, 
so that 4>y{w~^) = ^i,. Then Mi,{s)(pt^^s{^) = c^^^, where Ci, is the measure (in 
Ui,) of the neighbourhood above. Let v be archimedean. Consider, as above, 
which is compactly supported, modiilo P„, in the open cell PyW~^Uy, and 
such that the function u ^ (j)i,{w~^u) has the form hy{u)^i,, where by is a 
Schwarz-Bruhat function on Uy and ^^i, G Vr^ . ipt!^,s is a smooth section. Let 

a{s) = n / Ht~^/^{w-\)K{u)du . 

V archimcdcan jj 

Clearly a(s) is holomorphic, and functions hy can be chosen so that a(l) ^ 0. 
For this data, 

hence M(s)/^s(l) has a pole (simple) at s = 1. Note that ff^g is a smooth 
section. Let be the set of archimedean places. Then 

{<l>v)u^S^ ^ ^{^uGS^My{l)^^^^l{l)^{^y^S^y)){l) 

is a continuous nontrivial linear functional on 'S>i/eSoo ^^'^Pu hence it is 

nontrivial on the dense subspace of Yl K^-iimte vectors. Note, again, that 
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the intertwining operator is holomorphic at s = 1 at each place (otherwise, the 
Eisenstein series has a high-order pole at s = 1, which is impossible.) This 
provides a pole at s = 1 for M{s)ff^s{^) with ^ being if-finite. □ 

Remark 1. In the last proposition the choice of S is immaterial. If there 

is a set such that L^°{t, st, ^) / 0, then L^{t, st, ^) 7^ for any set 5 (as 
above), and similarly, if L'^" (r, A^, s) has a pole at s = 1, then L^{t, h?, s) has 
a pole at s = 1, for any set S (as above). The reason is that locally, at a finite 
place where is unramified L{Ty,st, 5) / and L{tu,A.'^, 1) / 0. Indeed, 

since Ti, is unitary the eigenvalues of its corresponding semisimple conjugacy 

1/2 

class (in GL2n(C)) are all strictly less, in absolute value, then [J-S3] and so 
L{tu, st, s) (resp. L(rjy,A^,s)) is holomorphic and nonzero at s = ^ (resp. at 
s = 1). Similar reasoning in the archimedean case implies that our assumption 
on the standard L-function of r is equivalent to L{T,st,^) 7^ (full L-function). 

Remark 2. Let r be a self-dual, irreducible, automorphic, cuspidal rep- 
resentation of either GL2n(A) or GL2n+i(A). As before, we can construct 
an Eisenstein scries, induced from the Siegel-type parabolic subgroup of G, 
where G is one of the following (split) groups 

SP4„, S04„, S04„+i, Sp4„^2 

(the last group is the metaplectic cover of Sp4„+2)- The analogs of the quotient 
of (products of) L-functions in (1.3) arc summarized in the following table 
(which includes the previous case of Sp4„) 



SP4n 


{T,st,s-1/2)L^ (tA'-^ ,2s-l) 
LS(T,si,s+i)L«(T,A^2s) 


SOi„ 


L'"'(t.A2,2s-1) 


S04„+i 


L^'{T,Syrn^, 2s-l) 
L^{T,Sym'^,2s) 


SP4n+2 


L^{T,Sym?,2s-l) 
L^{T,Sym?,2s) 



Note that, in the last case, r is a representation of GL2n+i(A), and in the 

remaining cases, it is a representation of GL2n(A). In all cases, except the 

last one, the functions cj) and ff^s arc defined in exactly the same way. In case 

SP4n+2 ) require that ^ is a smooth function on Sp4„_|_2 (A) , taking values in 

the space of r, such that 

^ 1/2 ^ 

(1.6) 0((m'u, 1)5; r) = 7^(det m)(det m, det m)5p {m)(f){g;rm) , 

for m G GL2„+i(A), u e Ua, g e Sp4„+2(A), r G GL2„+i(A). Here 7^(x) 
is the (global) Weil factor associated to a nontrivial additive character '0 
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of F\A. 7^ is a character of the two-fold cover of A*. It satisfies 7^(xi • X2) = 
jtp{xi)'y^{x2){xi,X2), for xi,X2 in A*. ( , ) is the (global) Hilbert symbol. 
ff,s{g) is constructed by multiplying (j){g) by H{gY~^/'^. We can now repeat 
the proof of the last proposition (word-for-word) and conclude that the cor- 
responding Eisenstein series has a pole (simple) at s = 1, if L'^(t, A^,s) has 
a pole at s = 1 in case S04n, or L^{t, Sym^, s) has a pole at s = 1 in cases 
S04„+i or Sp4„+2- 

2. The Sp2„ X Sp2„ -period of KeSs=i E{g, ff^s)- We go back to the case 
G = Sp4„, r - self-dual, irreducible, automorphic, cuspidal representation. 
We assume that L(r, st, i) 7^ and that there exists a finite set of places S, 
including those at infinity, outside which r is unramified, such that L^{t, A^, s) 
has a pole at s = 1. (See Remark 1 in the last section.) Note that this implies, 
in particular, that r has a trivial central character [J-Sl]. By Proposition 1, 
ReSs=i E{g, ff^g) is nontrivial (s = 1 is a simple pole.) Consider the subgroup 
H = Sp2„ X Sp2„, embedded in Sp4„ by 



(1.7) 





Bi 

-B2 
D2 



Each letter represents an n x n block. We sometimes identify, to our conve- 
nience, h and i{h) in Sp4„, for h G H. Denote 

Eiig,cl))=ReSs=iEig,ff^,) . 

The main result of this chapter is 

Theorem 2. Under the above assumption, Ei is integrable over Hf\Ha 
and {for a suitable choice of measures) 

(1.8) J Ei{h,(l))dh= J J <t>{k;(^ ^)d{a,b)dk . 

Hf\H^ Kh C2n(A)GL„(F)2\GL„(A)2 

Here Kh = K D H and C2n is the center of GL2n- 

This theorem and its proof are very similar to Theorem 1 in [ J-Rl] . Note 
that the inner GL^-integration, on the right-hand side of (1.8), is the integral 
(32) in [F-J.] (with s = = = !)• By Theorem 4.1 in [F-J], a necessary 
condition, for this integral to be nonzero, is that L'^(r, A^,s) has a pole at 
s = 1, and, in this case, the integral is of the form a{k;(l))L{T,st, |), where 
a{k;(f)) is a nontrivial linear form, for each k G Kh. Under our assumptions 
on r, the right-hand side of (1.8) is not identically zero. The proof for this is 
entirely similar to that of Proposition 2 in [J-Rl]. All the requirements there 
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are supplied by [F-J.]. Thus a{(p) = J a{k,(j))dk is nontrivial and hence the 

Kh 

period of Ei along H is nontrivial. Note that, exactly as remarked on the 
bottom of p. 178 in [J-Rl], formula (1.8) supplies another proof for the fact 
that if L(r, st, 5) 7^ and L^{t, A^, s) has a pole at s = 1, then E{g, ff^g) has 
a pole at s = 1. Moreover, the last remarks, together with (1.8) prove 

Corollary 3. Let t he a self -dual, irreducible, automorphic, cuspidal 
representation o/GL2n(A). Then E{g, ff^s) has a pole at s = 1 and Ei(-, (p) ad- 
mits a nontrivial period along H, if and only if L{t, si, ^) ^ and L^{t, A^, s) 
has a pole at s = 1. 

The rest of this chapter is devoted to the proof of Theorem 2. 

3. Truncation. As in [J-Rl], we consider the truncation operator applied 
to E{g,ff^s)- Denote, for a real number c, by the characteristic function of 
all real numbers larger than c. The only nontrivial constant terms of E[g, ff,s) 
along unipotent radicals of standard parabolic subgroups, are those taken along 
U or {1}. Thus, the truncation operator A"^, c > 1, applied to E{g, fr,s) is 

(1.9) h.^E{gjf^,)=E{gjl,)- ^ E^ {^g, fl,)X,{H{^g)) . 

'yePF\GF 

Since E{g, ff^g) is smooth and of moderate growth, A'^E{g, ff^g) is rapidly de- 
creasing. Also, the sum on the right-hand side of (1.9) has finitely many terms 
(depending on g and c). In particular, A'^E{g, ff^g) is meromorphic in s. (See 
[Al], [A2], for more details.) Similar remarks are valid for A'^E\{g, (f). By (1.1) 
and (1.9), we have 

(1.10) 

A'^E{g,ft^,) = E{g,ft^,)- ^ {ft^,{^g) + M{s)ft^,{^g))X,{H{^g)) 

= E f?,sil9mHhg))- E M{s)ft^g{jg)X,{H{jg)) . 
■yePF\GF tS-PfXGf 

This last equality is for Re(s) > n + 1. X"^ is the characteristic function of 
the interval (0, c]. Denote the first sum, in the last expression of (1.10), by 
^lig, fr,s), and the second - by ei{g, ff,s), so that 

(1.11) A'^Eig, ft^g) = ei{g, ff^g) - ei{g, ft^g) . 

Note again that the sum defining Q^^g, ft,s) has finitely many terms (depending 
on g and on c). In particular Q^^g, ft,s) is meromorphic in s, and so ft,s) 
defines a meromorphic function in the whole plane. (1.11) is now valid as an 
equality of meromorphic functions. 
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Denote Ress=i M(s) = Mi. Since fr,s is holomorphic, then an application 
of A"^ to El yields similarly, 

(1.12) A'Ei (g, 4>) = El (g, 0) - e^g, </>) , 
where 

(1.13) e^(5,0)= E Mi{ft^,{^g)X,{H{^g)) . 

Since K^E{g, ff^g) and A.'^Ei{g, cj)) are rapidly decreasing, they are bounded and 
hence integrable on Hf\Ha- We will prove 

Proposition 4. (^i{-,ff,s) is integrable on Hp\Ha, if Re{s) is suf- 
ficiently large, 62{-,ff,s) is integrable on Hf\H^, i/ Re(s) > 0, {and M{s) 
exists) and 6^{-, cp) is integrable on Hf\H^. The following formulae are valid, 
with a certain choice of measures: 
(1-14) 

I ei{h,ft,s)dh = ^ j I ct>{k;(^'' ^d{a,b)dk, 

Hf\H^ A-HC2n(A)GL„(F)2\GL„(A)2 



(1.15) 

j e'2{h,f$^,)dh 



J I M{s)i4^,)ik;(^'' ^^)d{a,b)dk 



s 

Kh C2n(A)GL„(F)2\GL„(A)2 



(1.16) 

j ei{h,<t>)dh 



= c~ 



i| j Mi((^f,(fc;(^" ^d{a,b)dk. 



This proposition will finish the proof of Theorem 2, exactly as in [J-Rl, 
p. 181]. Integrating (1.11) along Hf\Ha, first for Re(s) 0, and using (1.14) 
and (1.15), we get 

(1.17) I A'^Eih, ff^,)dh = ^JJ m ( " 5) d{a, b)dk 

M{s){4^,){k;h \dia,b)dk. 
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By analytic continuation, this makes sense in the whole plane. 
Taking residues in (1.17) at s = 1, 

(1.18) 

J A''Ei{h,(f))dh = JJ (p{k-(^"' ^d{a,h)dk 



= jj (t){k;{^ ^)d{a,h)dk- J ei{h,(t))dh . 



We used (1.16). Comparing (1.18) with (1.12), we conclude that Ei is inte- 
grable on Hf\H^ and that (1.8) is satisfied. 
Each of the functions 9j has the form 

(1-19) eji9)= E ^j^^9)- 

jePpXGF 

where 

r ftig)X'iHig)) , j = l 

(1.20) ^j{g) = I M{s){fis){g)MH{g)) , 3 = 2 . 

[M,{ft^,){g)X,{H{g)) , J = 3 

The sum (1.19), in case j = 1, converges only for Re(.s) ^ 0. Before proving the 
integrability of 9j on Hf\H^, and then compute its period on if, we proceed 
formally, 

(1.21) j 9jih)dh= I Yl ^3{lh)dh 

= E / (jilh)dh. 

jePF\GF/HF j-ippjnHF\H^ 

The set Pf\Gf/Hp is finite and will be described soon. Our task will be to 
show the integrability of each ^^(7/1) (in h)) on j'^Pf'J n Hf\H^, and then 
compute the integral. 

4. The set Pf\Gf/Hf- The description of this set is known. It appears 
as an ingredient in the "doubling method." See [PS-R, Lemma 2.1], for the 
description of the action of Hp on Pf\Gf, realized as the variety of maximal 
isotropic subspaces of the symplcctic space of dimension 4n. Using this de- 
scription and passing to a different basis of F^", so that H = Sp2„ x Sp2„ is 
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embedded in G by (1.7), we arrive at the following set of representatives for 
Pf\Gf/Hf. 



(1.22) 



Id 



Id 



id 



, 0<d<n , 



where 
(1.23) 

Note that 
( 



id 



In-d 


\ 


Id 







-In-d 


Ifi—d In—d 







Id 




In—d In-d / 



id 



V 



In-d 




Id 







-In-d 


In-d 







Id 




In—d / 



In—d In—d 






Id 






In—d 








In—d In- 


-d 




Id 






In- 


-d, 



A computation of the stabilizer of 7^ shows that 
(1.24) 

Hf n ja^PFid 



a X y 



c X 
a 



h u z 

c u' \ \ eHF 



a, be GLd{F) 
ce Sp2(„_d)(i^) 



Write this as the semidirect product k V^, where 

b 



Vd 



a,beGLdiF) 
ce Sp2(„_d)(F) 



Id X y\ I Id u z 

hin-d) x' \ , l2{n-d) u' \ \ £ Hf 

Id V Id 
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We now collect several conjugation formulae which will be used later. 




{i is the embedding (1.7)) 



/a 



In- 



n—d 



(1.25) 7dr7^ 



n—d 



In-d 



l-n-d 



For r = i( c , c II, where c 



hj V Id 

is the (n — d) X (n — d) block description of c G ^V2{n-d) (-^) i 



Cl C2 
C3 C4 



(1.26) 



Cl -C2 
-C3 C4 



-C2 



-C3 



Cl C2 
Id 

CS C4 



For 



xi ei 

In-d 

In-d 



yi \ 

J 



(Id 



X2 
In-d 



idj V 



62 



In-d — 



y2 \ 



e'2 



IdJ 
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(1.27) 



(id xi -ei 

In-d 
X2 Id -62 
In-d 



For 3m' = i 



e ez 
e* 



'2ji 



yi \ 
e'2 

y2 -62 



Ifi—d ^2 





IdJ 



(1.28) 



where 



n—d 



In-d 



— ez 


-e* 




IdJ 



(Id 



l-n-d 



Id 



i-n-d 



In-d 





In-d 





Id 



I-n-d 



5. A formal proof of Proposition 4. We first prove Proposition 4 formally, 
without paying attention to convergence issues. Denote 

Qd = iJ^Pid n H , 

^'"{(( ' ' ( ' ^*)) c,eGSp2(„_,)} • 
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Q'^ is a parabolic subgroup. Write its Levi decomposition as M'^ k V^. Note 
that MdCM'^. 

Following (1.21), we have to compute the integrals 

Ij,d= j ijildh) for 0<d<?7. and j = 1,2,3. 

Let < d < n. Write the Iwasawa decomposition in i^A, 

h = vm'k , m! G M^(A) , v G Fd(A) , k E Kh , 
dh = {m')dvdm' dk , 

where S is the modular function corresponding to the parabolic subgroup Q'^. 
Then 

(1.29) 

Kh Md(F)\M^(A) Va{F)\Va{A) 

By (1.27), the projection to GL2n of 7df7^^, as v varies in is a unipotent 
radical A^^ in GL2n, (since < d < n). Then H{jdV-f~^) = 1, and from (1.20) 
we see that (1.29) involves an inner integration of a cusp form in r along 
Nd{F)\Na{A), and hence 

(1.30) Ij^d = , for < d < n, j = 1, 2, 3 . 
In case d = 0, Qo = {(c, c) | c G Sp2„}. We have 

(1.31) Ij^o= J J ^j(^7oi(c,c)7o"Soi(e,l))dcde . 

Sp2n(A) Sp2„(F)\Sp2„(A) 

By (1.26), the projection of 7oi(6, 6)7(^^ on GL2n, as b varies in Sp2„ is Sp2„ 
(embedded as a subgroup of GL2n)- Since H{'yoi{c,c)jQ^) = 1, we obtain in 

(1.31) an inner integration of a cusp form in r along Sp2„(-F)\Sp2„(A), which 
equals zero by [J-Rl, Prop. 1]. Thus, 

(1.32) lj,o = 0, for i = 1,2,3. 
The only remaining case is d = n. Here 7„ = /4„ and 

Using (1.25) and (1.27), we have 
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(1.33) 



/ / 



(a 



Kh GL„(F)2\GL„(A)2 



a* J 



■II h 

Kh GL„(F)2\(GL„(A)2)o F*\A* ^ ^ 

• |tr2"("+i)|det(a6)|d*td(a,6)dA; . 



/ta 



tb 



kj\det{ab)\-^''+^U{a,b)dk 



t-'b 



1l* 



t-'a*J 



Here (GL„(A2))0 = {(a, 6) G GL„(A)2| |det(a6)| = 1}. Of course, in (1.33), we 
made a choice of measures. d*t will soon be specified. Thus, by (1.20) (recall 
also that, by our assumptions, r has a trivial central character) 



(1.34) 

Kh GL„(F)\(GL„(A)2)0 



)d{a, b)dk 



|^|2n(s-l)^*^ . 



teF*\A* 

|t|2»<c 



Choose d*t such that the corresponding (i*t-integral equals J ~ 



Re(s) > 1. The (i(a, 6)-integration yields one on C2„(A)GL„(i^)2\GLn(A)2. 
This proves (1.14). In a similar fashion, we get, for Re(s) > 0, 



(1.35) 



h,n= I I M{s){^%){k- 

Kh GL„(F)2\(GL„(A)2)0 



3L„(F)2\(GL 

/ / 



oo 

M(a,.)«/t<-')- 



dt 

T 



M(s)(^t)(^;( " A)d{a,b)dk 



Kh C2„(A)GL„(F)2\GL„(A)2 

and 
(1.36) 

Kh C2„(A)GL„(F)2\GL„(A)2 
In the next section, we justify our formal calculations. 



)d(a, b)dk . 
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6. Justification of the formal proof of Proposition 4. By (1.21), we have 
to examine the absolute convergence of the integrals Ij^d- The case d = n is, 
actually, rigorously proved in the end of the last section (1.34)-(1.36): 
(resp. /2,n) converges absolutely for Re(s) > 1 (resp. Re(s) > 0) and Is^n 
converges absolutely. 

Proposition 5. LetO <d< n. Then: 

1. Ii^d converges absolutely, for Re(s) large enough. 

2. I2^d converges absolutely, for all s where M(s) is defined. 

3. Is^d converges absolutely. 
In all three cases, Ij^d = 0- 

Proof. We start with formula (1.29). We will prove the absolute conver- 
gence (at the indicated domains in s) of 

(1.37) 

/ / / / 

Kh Md(A)\M^(A) Md(F)\Md(A) Vd{F)\Va{A) 

• ^jildVld^ ■ Id-rid^ ■ Jd'm'k)S~^{r)dvdrdm'dk. 

We realize Md{A)\M'^{A) as | ^ ^ x ^ , /2„j x G Sp2(„_d)(A)| and 

then use the Iwasawa decomposition, following the Siegel parabolic subgroup 
R' = L'^U', in Sp2(„_<i). 



X = 



e ez 
e* 



k' 



dx = dedzdk' 



Here e G GL„_d(A), z e U'^ = i^z\ (^""''^ ^^^j G C/^j, k' e K' — the 
standard maximal compact subgroup of ^V2{n-d) (A) ■ Let 



(Id \ 
Id 

In-d 
V In-d J 
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Then, by (1.25)-(1.28), the integral (1.37) equals 



(1.38) / 4>j{ke,zkoldk'k-(^'"^ y 



b \ u}dre,z)\ab\''^re,z\''' 
• Xj^cd^i^l \re,z\)dyd{a,b)dcdedzdk' dk . 

The integration is on 

y e M2d>,2(n-d){F)\M2dx2in-d){^), {a,b) G GL<i(F)2\GLd(A)2 , 

(n—d) {n—d) 

(A), eGGL„_d(A), zeW^, k' e K' 

(embedded naturally in Sp4„(A))and k G Kh- ke,z is the compact part of the 
Iwasawa decomposition in Sp4„(A) of the matrix, multiplying ko, on the right- 
hand side of (1.28), and r^^z is the projection to GL2(„_rf)(A) of its "Siegel 
parabolic part." (pj is defined as follows (see (1.20)). For g G Ga and m G 

GL2„(A), 

' ipt,s{g;m) , j = l 

(pj{g;m) = I M{s)i^pt,s)i9;m) , j = 2 , 



and for t G 



Finally, 



^j,c(*) 



X%t) 3 = 1 
Mt) i = 2,3 



s — n + d — 1 , i = l 
1 — s — n + d— 1, j = 2 , 
—n + d — 1 , i = 3 

' s + n , J = 1 
1-s + n , 3 = 2. 
n , j = 3 

In (1.38), we denote, for a matrix x, \x\ = |dctx|. Examining (1.28), we see 
that 



(1.39) 
where 

(1.40) 



i^dr^z = m z^d 



i-n+d 



'2d 



rUe. 



826 



DAVID GINZBURG, STEPHEN RALLIS, AND DAVID SOUDRY 



and me,z is the projection to GL2(„_rf) (A) of the "Siegel parabohc part" in the 
Iwasawa decomposition in S-p2(n-d) 

(A) of 



In-d 








In-d 






—z 


In-d 





-e* 


In-d, 



We want to estabHsh the absolute convergence of (1.38). For this, we use 
the majorization of cusp forms on GL2n(A), given in Proposition 6 of [J-Rl]. 
Since (pj is i^-finite, we find that, for each integer A'" > 1, there is a constant 
c', such that 



(1.41) 



(^'^ <c'max{l,|mp(--'^)|rr2'^} 



-AT 



for all /c G i^, m G GL2d(A), r G GL2(„_d)(A). Now, it suffices to replace the 
(i(a, 6)-integration m (1.38) by an integration on GL2(i(i^)\GL2d(A). By (1.40) 
and (1.41), it remains to consider 

(1.42) 4, = j ma^{l,|5|^("-'^)(|e*| \m,,,\r^''r'' \gP {]e*\ \m,,,\r'^ 

■ ^j,c{\g\ |e*| \me,z\)dgdedz , 

where g is integrated over GL2d(-F)\GL2(i(A), e-over GL„_(i(A) and z - over 
U'^. Before proceeding to each case, let us prove two lemmas. 

Lemma 6. For all e G GL„_(i(A), z G U'^, 

(1.43) |e*| \me,z\ < 1 ■ 

Proof. Write the Iwasawa decomposition of Ug^z^ at each place v, following 
the Borel subgroup of Sp2{n-d)il^i^)^ 



\ 



* 



t2{n-d) 



t 



2(n-d) 



Then 



(1.44) \me„zj ^ = \t2{n-d) *l| ^ = \\£-2{n-d)Uu ^£-lUu\ 
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where {ei, . . . , £2{n-d)l^-2(n-d)j • • • ) £-2, £-1} is the standard basis of row vec- 
tors in F^^"'~'^\ For a row vector v = (xi, . . . , x^) G F^, we let 



max;i<j<^ \xi\ , v < 00 



( E ) 



1/2 



= R 
= C 



(If is archimedean, the norm on f\^^'^~'^) F^^^ '^^ is defined through the or- 
thonormal basis obtained from the standard basis {ei, . . . ,£-1} above.) Prom 
(1.44), we get (with self-explanatory notation) 



-1 



> ||(£-(n-d) e £^n-d) A • • • A (£_i © E^) 



'61/, 2i/ I 

where En-d, ■ ■ ■ Ei are the rows of the matrix — e* ; 

-e: ' 



El 



(See definition of Ue,z-) In particular, 



1-1 



> \\En-d A ■ ■ ■ A Eill = |e*| = |ej. 



-1 



This implies (1.43) at all places u; hence (1.43) is satisfied. This proves the 
lemma. □ 

Lemma 7. Let t be a real number. Then the integral 
A = I I (|e*| \mez\Ydedz 



U'^ GL„_d(A) 

converges, provided t is large enough. 

Proof. We first consider the local analog of A, at each place u, 

Au = J J i\e*\ \me,z\fdedz . 

K GL„_d{F,) 

Split into two summands A^}^ +A^\ where in aI^\ we integrate over |e| < 1 
and in A^^ - over |e| > 1. We have 

4'^ = JJ \me,z)Ydedz = jj (|e| \me,z\fdedz . 



N<i 



N>i 
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We changed variable e i-^ — e ^ and z i— > —z and me,z is the projection to 
GL„_c;(A) of the "Siegel parabohc part" in the Iwasawa decomposition in 

SP2(n-d)(^) of 

\ 











In-d 




e 


Z 


I-n—d 


e-1 


e' 


Ifi—d, 



Let da{e) be the additive measure on Mn-d{Fu)- Then de 



dgje) 
|g|n-d 



and 



(1.45) 



4'^ < JJ (|e| \fhe,,\Ydaie)dz . 



\e\>l 



As in (1.44), 

(1.46) \fhe,z\~^ = \\{e_2(n-d) ® £n-d © ^n-d) A • • • A (£_(„_d)_i © f i © Zi) 

A (e_(„_rf) © E^_d) A • • • A (e_i © Ei)\\ , 



where 



Si 



Zfi—d 



Zl 



' En-d 

El 



Hence 
(1.47) 

\fne,z\~^ > \\{£-2{n-d) + £n-d + Zn-d) 

A • • • A (e_(„_d)_i +Si+ Zl) A Eri-d A ■ ■ ■ A ^i|| 
= \\{£-2(n-d)+Sn-d+Zn-d) 

A • • • A (e_(„_d)_i+£:i + Zl) A Sn-d+i A ■ • • A £2(n-(i) II ■ |e| 

= ll(e-2{n-d)+^n-d) 

A--- A(e_(„_rf)+£:i) A£n-d+i A--- Ae2(„_d)|| • |e| =a(e)|e| . 

From (1.46), we also obtain 

(1.48) _ 

\me,z\ ^ > \\{s-2{n-d) + £n-d + Zn~d) A ■■■ A (£_(„_d)_i + 2;i)|| = a{e, z) . 

Prom (1.47) and (1.48) 

|me,.|-^>«(e)V2|e|V2.«(,^,)i/2. 

hence, for t >0, 

(1.49) (|e| |me,.|)* < (|e|a(e)-^a(e, z)-!)*/^ . 
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Let, for a matrix b, 

' max{l, ||6||} , u < oo 
A,(6) = I (l + ||6|nV2 , F, = R . 

+ F, = C 

Then, by the definitions of a(e) and a{e, z), 

> |e| and a(e) > Xu{e) 
oe{e,z) > \e\ and a{e,z) > Xi,{z) ; 

hence 

a{e)a{e,z) > |e|A^(e)^/^A^(z)^/^ . 
Using this in (1.49), we get 

(|e| |me,.|)* < A,(e)-*/4A,(z)-*/^ . 
Thus the integrabihty of A^^ follows from that of 

J K{er'l^da{e) ■ J K{z)-"^dz 

|e|>l K 

which is valid, for t » 0, by Proposition 7 in [J-Rl]. Similarly, 

4'^ = jj (|e*| \me,,\fdedz= jj (|e| |r?i,,,|)*^dz 

|e|>l |e|<l 

• jj \ef~'''^'^\-me,zfdaedz < jj \me,z\* dacdz , 

|e|<l |e|<l 

fov t > n — d. As before 

{rhczl'^ > K{e) and \fhe,z\ > Kiz) ; 

hence 

4'^ < jj K{e)-''^K{z)-"^da{e)dz < jj X,ie)-'/^X,{zy'/Ua{e)dz . 

|e|<l |e|<l 

All in all, 

A, = + < y j \^{e)-"^X,{z)-"Ua{e)dz = r^t) 

and the last integral converges absolutely for f ^ 0, by Proposition 7 in [J-Rl]. 
By the same proposition, W r^{t) converges for t 2> 0. This proves the absolute 

convergence of A and Lemma 7. □ 
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We go back to the convergence of Ij^ in (1.4.2). 
Case 3 = 1, < d < n. Here (in (1.42)) 

(1-50) \9\<ci\e*\\me,,\)-^ . 

Integral (1.42) splits into two summands I^^ ^^^^ summand, we 

integrate along 

(1-51) \9\<i\e*\ K,.!)'^/"-'^ . 

We have 

(|e*| |me,.|)'^/"-'^<c(|e*| |me,.|)-^ 

due to Lemma 6 and the fact that c > 1. Thus (1.50) is redundant in I^^. We 
have 

(1.52) l[]l= I \gr^+''-\\e*\\me,,\r+^dgdedz . 

\a\<i\e*\ IrrieM)"^"-" 
3eGL2d(F)\GL2d(A) 

eeGL„_rf(A),zeW^ 

The dg-integration in (1.52) is proportional to 

(|e*| \me,z\f^"-'^ 

/ ^ ^-^(|e*| |me.|)^(^-"+''-') 

J t s-n + d-r''' ' ''^ 



for Re(s) > n — d + 1. /^^j is then proportional to 

(1.53) j (|e*| |me,^|)^(^-"+''-')+^+"dedz 

(that is, it is enough now to get the absolute convergence of (1.53)). By Lemma 
7, sine 

(1.54) 



7, since Re(s) 3> 0, (1.53) converges absolutely. Now consider I^; j. 



7-(2) _ 



I 



(\e'\ |me,.|)''/"-''<|3|<c(|e*| |me,z|)-l 
9eGL2<i(F)\GL2d(A) 
eeGL„_rf(A), zeu'^ 

|^|_2(„-d)iv+.-n+d-i^|g*| \rne,,\f''''^'^''dgdedz . 

The (i(7-integration is proportional to 

{c{\e*\ |me,.|)-^)-("-'^)(^^+^)+--^ (|e*| |me,.|)^^'^""^^^^^+^)+^-^^ 
-(n - d){2N + 1) + s - 1 - d){2N + 1) + s - 1) 
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Thus (1.54) is a difference of two integrals. One is proportional to 

Ji= J (|e*| |me,^|)"(^^+^)+"-'^+^dedz 
and the other is proportional to 

J2 = y (|e*| \me,z\)^'^''~'^^^dedz . 

The integral Ji converges absolutely, since we may choose N as large as we 
want, and then apply Lemma 7 and similarly, in J2, we assume that Re(s) 3> 0, 
and get the convergence again. 

Case j = 2 , < d < n. Here (in (1.42)) 

(1.55) H >c(|e*| K,,|)-^ 

Again, split (1.42) into two summands + I^^. In the first summand, 
integrate along (1.51). Thus, by (1.51) and (1.55), 

c(|e*| K,.|)-i<bl<(|e*| K,.!)'^/"-'^ 

and, in particular, (|e*| |me,^|)"^"^'' > c. Since c > 1, this contradicts 

Lemma 6. Hence the domain of integration of I^^ is empty, and we need 

(2) (2) ' 

only consider Jgj- The integration in l!^^ is over g satisfying (1.55) and 

\g\ > (|e*| \me^z\)'^^^~'^ ■ By Lemma 6, this last condition is redundant (in 
the presence of (1.55)). Thus, 

(1.56) = 43 = I Igr-i^-^^^'^'+^Hnm^Mdedz . 

M>c(le*l |me,,l)-l 
96GL2d(F)\GL2d(A) 
eeGL„_d(A), zeu'^ 

The dg'-integral in (1.56) is absolutely convergent, once we take N large enough 
(relative to s,n,d), and is proportional to 



00 

(„_,)(2iv+i)^ ^ (c(|e*| |me,.|)-^)---("-'^)(^^+^) 
t -s-{n-d){2N+l) 

c(|e*| |m,e,z|)"^ 



00 

/ 



Thus (1.56) is proportional to 

I {\e*\ |me,.|)'"(^+^)-'^+^dedz , 



which converges absolutely, provided we choose N ^ 1 (Lemma 7). 
Case j = 3, < d < n. This case follows exactly as Case j = 2. 
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Case J = 1, d = 0. By (1.38)-(1.40), we have to consider integrals of 
the form 



dbdedz 



zeW^ eeGL„(A) 6eSp2„(F)\Sp2„ 
|e*| \me,z\<c 



for ip in the space of r. Note that, by Lemma 6 (and c > 1), |e*| \me^z\ < c 
always holds. Since ip is bounded, (and Sp2„(-F)\Sp2„(A) has finite volume), 
it is enough to consider the convergence of 



,\y+''dedz . 



This integral converges absolutely for Re(s) large enough (Lemma 7). 
Case j = 2,3; d = 0. Similar to case j = 1, we have to consider 

J J J ^,^me,z){\e*\\me,z\)'-'+^dbdedz. 

zeU' eeGL„(A) 6eSp2„(F)\Sp2„(A) 

^ |e*| \me,z\>c 

The domain of integration is empty here, by Lemma 6 and the fact that c> 1. 

We proved assertions (l)-(3) of Proposition 5. They provide the justifica- 
tion to the formal proof in Section 4, which shows that Ij^d = for j = 1, 2, 3 
and < d < n. This concludes the proof of Theorem 2. □ 



2. A tower of correspondences for GL^ 

1. Definition of the tower. Let r be an irreducible, automorphic, cuspidal, 

representation of GL2n(A). Assume that r is self-dual. As recalled in the in- 
troduction, exactly one of the partial L-functions L^{t, A^, s) or L'^{t, Sym^, s) 
has a pole (simple) at s = 1. Consider the Eisenstein series on S04n(A), in the 
first case, and on S04n+i(A), in the second case, induced from the Siegel-type 
parabolic subgroup, the representation r and the same complex parameter s, 
as in Chapter 1 Denote it by E{g, f},s), keeping the notation of Chapter 1. In 
subsection 1.1, we have seen that it has a simple pole at s = 1. Let 

Eiig,cl>) = ResEig,ff^^) . 

s=l ' 

By taking a sequence of certain Fourier coefficients of Ei along certain unipo- 

tent subgroups of S04„, in the first case, and of S04„+i, in the second case, 
and restricting to subgroups of the form S02fc+i(A) (resp. S02fe(A)), we obtain 
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a "tower" of spaces of automorphic representations (Tfc(r) of S02fe+i(A) (resp. 
of S02jfc(A)) which are generic 

S04n-l(A) 

/ : 

^2 1) ^ on GL2n(A) S02n+l(A) 

\ ; 

\ S03(A) 
SOi(A) 



(2.2) 



S04n(A) 

T on GL2n(A) S02n(A) 

\ : 
\ S02(A) 

{1} 



We will prove that the last step in the tower is always nontrivial and that 
in the first step k, where afc(r) is nonzero, o"fc(r) is also cuspidal. In this 
sense, the towers resemble Rallis original symplcctic-orthogonal towers. In case 
(2.1), we can be more precise and distinguish two cases, according to whether 
L^{T,st,^) 7^ or not. If L^{T,st,^) ^ 0, consider the Eisenstein series 
E{g, fts) on Sp4„(A) (as in Chapter 1). Again, by 1.1, E^{g, 0) = Res E{g, ff^g) 

s=l 

is nontrivial, and by taking a sequence of certain Fourier-Jacobi coefficients 
of Ei{g,(/)), we construct another tower of liftings to automorphic, generic 
representations of Sp2fc (A) 

SP4n-2(^) 

^ ^ '■ 

^2 3) T on GL2n(A) — > Sp2„(A) 

\ ^ '■ ^ 

Sp2(A) = SL2(A) 

\ {1} 

Towers (2.1) and (2.2). Let G be one of the groups S04„ or S04„+i, acting 
from the left on the column space W = F'^"- (resp. W = F^"+i) equipped with 

the quadratic form defined by ( . • ' | . Let {ei, . . . , £2n, ^-2n-, ■ ■ ■ > ^-i} 
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(resp. {ei, . . . , £2n; £0; e-2n; • • • be the standard basis of W. Let Vg~ = 

Span{£i, . . . ,6^} (1 < ^ < 2n). This is an ^-dimensional isotropic subspace 
of W. Its dual in W is = Span{e_i, . . . , e_^}. Consider the parabolic 
subgroup Pk of G, which preserves Ek = V'^n^k-i (I'Gsp- = y<^_i^)- Its Levi 
decomposition is = x C/fe- is abelian, in case dimE'^ = 1, or in case 
dim£^fe = 2n, when G = S04„, and otherwise, it is a two-step nilpotent group. 
The Siegel parabolic subgroup P corresponds to A; = — 1 (resp. A; = 0) Let E'j^ 
be the dual of E^ inside W, and let Wk be the orthocomplement of E^ + E'j^ 
in W. Then 

Mk ^ GUEk) X SO{Wk) , 

and U^^ is isomorphic to the space of matrices of size diuiEk x dimM^fc. Let 
ccfc = dimEk, /3k = dimW^. In matrix form, an element of Mfc has the form 
/a \ 

m = b , where a G GL{Ek) and b G SO{Wk), and an element of 



U^^ has the form 



(2.4) u 
Conjugation by m gives 



'la, aYb-^ * 




Vo 



(2.5) mum-' = \ Ip, bY'{a*)- 

If we realize as E^^W^, where is the dual of Wfe, written in the form 
of rows in (3^ coordinates, then conjugation (2.5) by m of u, which corresponds 
to e®v, gives ae®v ■ b~^. Define 

*eo; dimW^ = 4n + l 

*e2n +* £-2n, dim 1^ = An . 

Denote (again) the symmetric bilinear form on by (,), where (*t'i,*t'2) = 
{vi,V2), for vi and V2 in W^. Denote 

(2.6) J/fc = e-afc^vo • 

Fix a nontrivial character ip of F\A and define the following character of 
Uk{F)\Uk{A). Let u in Uf{A) correspond to y G Ek{A)i®W*{A). Then 

(2.7) Mu) = Hiy^yk)) , 

(where ( , ) is extended naturally to {E^. + E'f.){A)(®W^{A)). In matrix form 
(n as in (2.4)) 

f V'(^2n-fe,fc+i), dim = 4n + 1 

1 i'{Y2n-k-i,k+i- + ^2n-fe-i,fe+2), dim W = 4n 



(2.8) Mu) 
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The stabilizer of V'fc in SO(Wfe) is 
plement of ^vq in W^. Note that 



SO(W^), where W'f. is the orthocom- 



(2.9) 



r S02fc, dimW = 4n + l 
|s02fe+i, dimW = 4n 



The stabihzer of ip^ in GL(^fc) is the mirabohc subgroup (of type {a^ — 1, 1)); 

in particular, it contains Z^^. - the standard maximal unipotcnt subgroup of 
GL{Ek). Extend ipk to Zaf.{A.) by the standard nondegenerate character of 

Zai^{A), defined by ip, i.e. it takes z in Zq,;.(A) to '0( 5^ z^^^+i). This defines 

£=1 

a character tpk of Nk{A), where Nj. = ^a*; • Uk- 

Consider the Eisenstein series E(g, ff^s) of Chapter 1 (mentioned in Re- 
mark 2, following Proposition 1). Recall that r is an irreducible, automorphic 
cuspidal representation of GL2n(A), which is self-dual. ^ is a smooth X-finite 
function in Indp|^| r. P = M k U is the Siegel-type parabolic subgroup of 
G = ^0{W). Finally 

(2.10) 4^,{g; m) = H{gy-^l''^{g; m), 

fU9) = <s{9■^) , 



g eGa, me GL2„(A) 



and if g is written in the Iwasawa decomposition auk, for a G GL2n(A), u G 
U{A), k gK, then H{g) = \ deta\. 

Assume that E{g,ff^s) has a pole at s = 1. Let (7jfc(T) be the representa- 
tion, by right translations, of Hk{A) on the space spanned by the ■i/'fc-Fouricr 
coefficients of Ei{g,(p), along N^, restricted to Hk{A). That is, the space of 
a"fc(r) is the space of automorphic functions on Hk{A), of the form (2.11) 



(2.11) 



Pk{h) =pk{h,(p) 



Ei{vh,(j))'ipkiv)dv 



iVfc(F)\JVfe( 



The tower (2.3). Here G = Sp4„. Let W = F^" (column space), with the 

/ 1\ 



symplectic form ( , ) defined by 



V-1 



Let 



{ei, . . . , e2n,£-2n, • • • ; C-i} be the standard basis of T^. Define V^, 1 < £ < 2n, 
as in the previous case, and E^ = V^_^,. Let be the parabolic subgroup of 
G, which preserves E^. Its Levi decomposition is = ^U^- is abclian 
in case dim£^jt = 2n (i.e. /c = 0), and otherwise it is a two step nilpotent 
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group. Let E'^. and Wk be as in the previous case. Then — GL(£'fc) x 
Sp(VFfe) = GL2n-fe X Sp2fc. The Siegel paraboUc subgroup P corresponds to 
A; = 0. Let = Z2n~k'Uk {Z2n-k is the standard maximal unipotcnt subgroup 
of GL(i?fc) = GL2n-fc)- Define a character ipk on Nk{A) to be trivial on [/fc(A) 
and the standard nondegenerate character (corresponding to ip) on ^2,1-^ (A). 
Note that ■0^ is fixed by Sp(Wfc)A. The group Nk/Nk+i is isomorphic to the 
Heisenberg group Tik in 2A; + 1 variables. In matrix form, v in A^^ looks like 
this 





* * 


* 






1 e 


y 


* 




hk 


e' 


* 






1 


* 


V 









2Ik 



2n-(fc+l) • 



Then the isomorphism takes v modulo Nk+i to (e; y) where e = e- 

Denote the composition of this isomorphism with the quotient map Nk — >■ 
Nk/Nk+i by jk- Consider the Weil representation of Sp2fc(A) ~ the global 
metaplectic cover. It comes with a choice of a nontrivial additive character 
of F\A. We choose ip. Denote the Weil representation by iv^^k, and extend 
it to Hfc(A) • Sp2fe(A) by the Stone von- Neumann representation (of central 
characters tp) on TCk{A). We still denote this representation by u;.^, fc. It acts on 
the space S{A'') of Schwartz-Bruliat functions on A*^. Consider its automorphic 
realization on the space of theta series 

(2.12) el^^ih) = co^,kmi^y^ he -Ha- S^2fc(A), ^ € S{A') . 



Let T be an irreducible, automorphic, cuspidal representation of GL2n(A). 
Assume that L^{t,A^, s) has a pole at s = 1 and that L(r, st, ^) ^ 0. Then 
the Eisenstein series E{g,ff^s) has a (simple) pole at s = 1 (subsection 1.1). 
Let (Tfe(r) be the representation, by right translations, of Sp2,fc(A), on the space 
spanned by coefficients of Fourier- Jacobi type on Ei{g, (p), namely the functions 
Pkih), where 

(2.13) Pk{h)=Pk{hA,0 = 



I E,{vh,ct>)9l,{jk{v)h)i;^\v)dv . 



Nk(F)\Nk{A) 

Here h G Sp2fe(A), ^ as in subsection 1.1 and ^ G S{A''). The appearance of 
h in Ei{vh,(t)) factors through Sp2fe(A). Denote, for this tower Hk = Sp2k- 

The case of GL^, where m is odd. Assume that m = 2n -|- 1. Let r be 
an irreducible, automorphic, cuspidal representation of GL2n+i(A). Assume 
that T is self-dual. In this case, it is known that L'^(r, A^,s) is holomorphic. 
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and hence L'^(r, Sym^, s) has a pole at s = 1. Consider the Eisenstein series 
E{g,ff^s) on Ga = Sp4„_,_2(A). It has a pole at s = 1. As in the last case, 
consider the groups Uk and Ni^ (only now dim Ei^ = 2n — k + I), tp^ is the 
character of Nk{A) = Z2ri-A:+i(A)[/fc(A), which is trivial on C/fc(A) and is the 
nondegenerate character on Z2n-fe+i(A). As in the tower (2.3) and (2.13), 
let c7fc(T) be the representation, by right translations, of Sp2yfc(A) on the space 
spanned by coefficients of Fourier- Jacobi type on Ei{g, 0) namely the functions 
Pk{h), where 

(2.14) Pk{h)=pk{h,(t>,0= J Ei{vh,(t))el,ijk{v)h)^^\v)dv . 

Nk{F)\Nk{A) 

Here h G Sp2fc(A), - as in subsection 1.1 and ^ G S{A''). Note that in (2.14), 
we may take any preimage of h in Sp2fe(A). 
This defines a tower for r on GL2n+i(A) 

Sp4n(A) 

/ : 

(2.15) r on GL2„+i(A) Sp2„(A) . 

\ : 

Sp2(A) 

\ {1} 

Denote, for this tower, Hk = Sp2fc. 

The definition of (Tk{T) through formulae (2.11), (2.13) and (2.14) is not 
accidental. It is prescribed by Rankin-Selberg integrals which represent the 
standard L-function for x GL^ (see [G-PS], [G],[So], [GRS2]). More pre- 
cisely, let cr be an irreducible, automorphic, cuspidal representation of Hk{A) 
{Hk is considered in each of the cases G = S04„, S04„+i, Sp4„, Sp4„_,.2)- Let ip 
be a cusp form of a, then the integral 

(2.16) J ^{h)^dh 

Hk{F)\Hk{k) 

is the residue at s = 1 of the Rankin-Selberg integrals mentioned above (it is 
obtained from (2.16), by replacing Ei{h, cf>) with E{h, ff,s) in the definition of 
Pk{h).) We remark that similar towers of unitary groups can be constructed 
with the aid of similar global integrals (the theory should resemble the previous 
cases; see [T], [Wt].) 

2. The tower of correspondences. Let G be one of the groups S04n, 
S04„+i,Sp4„, Sp4„_,_2, and let r be an irreducible, automorphic, cuspidal and 
self-dual representation of GL^(A), where m = 2ra or m = 2n -|- 1, such that 
the corresponding Eisenstein series E{g,fr,s) has a pole at s = 1. Consider 
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the representation a"fc(r) of if/; (A), acting by right translations in the space 
spanned by the functions pfe(^) ((2.11), (2.13), (214)). 
Our main theorem in this chapter is: 

Theorem 8. Assume that ak{T) = 0, for 1 < k < i - 1. Then a£{T) is 
either zero or cuspidal on i7^(A). 

This is the weh-known property of the symplectic-orthogonal towers of 
theta hftings [R] . (See also [GRS3] , for another tower for G2 , within exceptional 
groups.) The towers we present here "should start" at level k = n. We cannot 
prove this at this stage^*^ but at the third chapter, we will prove that, in case 
G = Sp4„, crfe(r) = 0, for 1 < < n. Once we prove that (7„(r) is nontrivial, 
then anir) is a cuspidal representation of iJ„(A), associated to r (such that 
E{g, ff^s) has a pole at s = 1). The correspondence r 1-^ CniT) should be the 
explicit backward map to the functorial lift from GL^ to {m = 2n, 2n + 1). 

We first prove (recalling that P = M x U denotes the Siegel parabolic 
subgroup of G), 

Proposition 9. 

1. The constant term of Ei{g,(f)) along any unipotent radical of a standard 

parabolic subgroup, different from P, is zero. 

2. The Whittaker coefficient of Ei{g,(p), along the maximal unipotent sub- 
group of G, is zero. 

3. Let Zm be the standard maximal unipotent subgroup of GL^, embedded 
naturally in M the Levi part of P. Consider the standard nondegenerate 
character o/Z„j(A), defined by ip, and continue to denote it by tp. Then 
the following coefficient is nontrivial, 



Proof. Part 1 follows, since E{g, ff^g) is concentrated on P. Part 2 fol- 
lows since the Whittaker coefficient of E{g,fr,s) is holomorphic at s = 1. 
(The proof uses the formula on p. 352 of [Sh], for the Whittaker coefficient 
of E{g,fr,s)- The product of L-functions, which appears there, is that given 
by the denominator in each case of (1.5). As explained (in parenthesis) in the 
proof of Proposition 1, each such denominator is nonzero (and holomorphic) 
at s = 1. To complete the argument, use Proposition 3.1 in [Sh]. The proof 
in case E{g, ff^g) is on Sp4„ is exactly the same.) As for part 3, consider the 



Added in proof . As wc mentioned in tlie introduetion. we now ean prove that u„{t) =^ 0. Tlie 
case G = Sp4„ appears in [G-R-S5]. Tiie remaining cases will appear in a work under preparation. The 
fact that the unramified parameters of r and (7„ (t) correspond, for G = Sp4„ appears in [G-R-S6] . 
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constant term of Ei(g, (p) along U. Then by part 1, it defines a cusp form ^ on 
GL^(A) = Ma and so ^ has a nontrivial Whittaker coefficient (with respect 
to Zjn and ip). This proves Proposition 9. □ 

Proof of Theorem 8. The proof uses Fourier expansions and Proposition 
9 (parts 1 and 2). We present the proof in cases G = S04„+i and G = Sp4„. 
The proof in the two remaining cases is entirely similar. 

Case G = S04n-|-i. Let Rp denote the unipotcnt radical of the standard, 
maximal parabolic subgroup of = S02£, whose Levi part is isomorphic to 
GLp X S02(^_p) (1 < p < t). The elements of Rp, naturally identified with 
matrices in S02£, are of the form 



'Ir, 



(2.17) 



X 



The corresponding element in S04„+i is 
/ hn-i 



(2.18) 



X2 



le-p 



Y 

X'2 



x[ 



V 



hn-e I 



where X = {Xi,X2). We want to prove that 

Pi{r, (j))dr = 0, for all 1 <p < £ 



I 



RpiF)\RpW 
which, by (2.11), means that 

(2.19) 



Ei(vr, (p)'ipe(v)dvdr = . 

Rp{F)\Rp{A) Ne{F)\Ni(A) 

Wc want to relate the integral (2.19) to an integral over the group N^^p. For 
this, it is convenient to conjugate the variables in (2.19) by the Weyl element 



'2n- 



h{e-p)+i 



hn-e 
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Conjugating vr, in (2.19), by (3, we get a matrix of the form 



(2.20) 





Xi 


t 


X2 


D 


^\ 

D' 


L 


Z A 


b 


C 


E 




le-p 








a 


X', 




1 



le-p 


b' 

A' 

z* 


t' 




V 








v 


Ip 1 



with t = Q and Z G Zm-i- Note that 

Denote S = (dN^Rpfd-'^. The identity (2.19) (after replacing [5 
equivalent to 



by 0) is 



(2.21) 



j Ei{s,<P)iPi{p-hp)ds = . 



Sf\S^ 



Let S be the subgroup of matrices (2.20) with L = 0, t = and Z = hn-e- 
Denote by C the subgroup of matrices (2.20), that have all coordinates above 
the diagonal equal to zero. As usual, we identify Z2n-e as a subgroup of S. 
Then the left-hand side of (2.21) equals 

(2.22) J J J ^ii^^^'^)MP''^sz(3)dsdxdz . 

Denote by ut a matrix of the form (2.20), with all other variables, except 

for t (and any appropriate Y) being zero. Consider the function of F^\A^, 
1 1-^ f Ei{utsh, (j))ilJi{P~^sP)ds {h is fixed). Take its Fourier expansion and 

Sf\Sj^ 

substitute t = 0. Then it is easy to see that it equals 



(2.23) 
where 



,(0) 



Y. 


v=(v 




vjeF 




(Ip 









7] 







j Eiiur]^'>h,4>)A-piu)du 



Ue-j,(F)\Ui_piA) 



'2n-£-l 

1 



2{e-p)+i 



l2n-l-l 





Ip) 
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Recall that Uk is the unipotent radical of the standard parabolic subgroup Pk- 
Using (2.23), we see that (2.22) equals 



(2.24) 



/ / / 



Ei{uxz, (l))ilj(-p{uz)dudxdz , 



e{F)\Z2 



where C is the subgroup of matrices (2.20) in £, such that the last line of L 
is zero. Denote by C^^^ the subgroup of matrices (2.20) in C such that L has 
all lines zero except for the last one. Write 

where consists of all matrices (2.20) in C' such that L has all lines zero 
except for line 2n — ^ — 1, while C corresponds to L with line 2n — ^ — 1 (and 
of course line 2n — t) being zero. Also 



Then (2.24) equals 
(2.25) 



1 



and Z 



C 



2n-i 



I I I 



Note that a;^^^ G C^^^ and z^^^ € Z^^ commute. Consider the function on 

F^\A^, a !—>■ J Ei{uah)'ip£-p{u)du {h fixed), where 

C/^_p(F)\C7^_p(A) 



flp a 

1 



v 



1 



\ 



a 

IpJ 



The Fourier expansion of this function (at a = 0) is 
(2.26) 



j J Ei{uah)'ip£-p{u)'il){ri ■ a)duda . 

"^^^ FP\AP Ue_p(F)\Ue_p{A} 
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Let 



•.(1) - 



r? 1 



h{i-p)+2, 



1 l2n-e-2 

rj' IpJ 



Then, fixing x, z, in (2.25), the inner-triple integration equals, using (2.26), 

Note that r?(i)ar/(i)"'z(^) = az'^^^ and • a)'tpi_p{z^^^) = V'^_p(z'(i)). We get 
that (2.25) equals 

^'■''^ I I I I I 



^f\£a ^"^^^ C/,_p(F)\[/,_p(A) 

■ £;i(uSz(^)5Far(^)x(°\0)^^_p(uzWi)d(---) . 

Repeat the same steps, only that now, consider the function on FP\M 
(2.28) 

J J J Ei{uaz^%h,(j))ipe-piuz^^^)dudadz^^^ 

J" ' A 

for h fixed and 

/Ip b \ 

hn-l-2 
1 

h{i-p)+z 

1 h' 

hn-l-2 

IpJ 

Write the Fourier expansion of the function (2.28), as in (2.26), and use 
r) 1 



6 = 



V 



(2) = 



L 



2{e-p)+5 



hn-e-s 
ri' 1/ 
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instead of rj^^^ in the previous step. Split £ = . jC, Z = Z^^'^Z. C^^^ 
consists of all matrices (2.20) in £, such that L has all lines zero, except for line 

2n — £ — 2, while C corresponds to L with lines 2n — £ — 2,2n — ^— 1 and 2n — £, 





being zero. 



Note that for z^^) g 7^(2)5^(2) ^^(s) = i)z'{2) ^ foj. ^/(2) ^ ^(2)^ ^^^^i that 

'(/'(r/ • b)il)i-p{z^'^^) = 'il)i-p{z'^'^^), and so on. We repeat this procedure until we 
get 



(2.29) 



/ / 

U*{F)\U' 



Eiiyx, 4>)'^t-p{v)dvdx 



where Ul_^ is the subgroup of matrices in N^^p 
(2.30) 
(Ip A X 
Z B 



\ 



Consider the function 
(2.31) 



D 




C 


D' 


B' 


X' 


Z* 


A' 




Ipl 


1 — > 





, with A having zero in the first column 



h, (j))il;e^p{v)dv 



where m G GLp(A), e G (columns...) and 

f m e 



m e 
1 



lAn-2p-\ 



V 



1 e' 
m 



The function (2.31) is "automorphic" and "cuspidal," in the sense that all con- 
stant terms are zero, as follows from Proposition 9. Thus its Fourier expansion 
(as for cusp forms of GLp+i(A)) yields that (2.29) is equal to 



(2.32) 



where 7 = 



E 



Ei{vjx, 4>)'^i-p{v)dvdx 



7eZ^(F)\GL^(F) iV,_^(F)\JV, 

'7 



lAn-2p+l 



r 
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Let us record the identity that we proved 

(2.33) J J Ei{vr,(j))ipe{v)dvdr 

Rp{F)\R„{A) Ne{F)\Ne{A) 

= ^ / / Ei{v'^xl3,(f))tpi_p{v)dvdx 

or, in the notation (2.11), 

(2.34) J pi{r,(p)dr= ^ J pi_p{jx, P ■ (l))dx . 

Rp{F)\RpiA) 7G^p(F)\GLp(F) 

By our assumption pk[h,(j)) = 0, for 1 < k < L Note that pQ{l,(j)) is the 
Whittaker coefficient of Ei{-,(p), which is zero (Proposition 9). Thus, (2.34) 
impHes that the constant terms of pe along the unipotent radicals Rp are zero, 
for 1 < ^? < ^. This completes the proof in case G = S04„+i. □ 

Case G = Sp4„. Let Rp denote the unipotent radical of the standard, 
maximal parabolic subgroup of Sp2^, whose Levi part is isomorphic to GLp x 
SP2(£-p) (1 < P < ^)- We identify the elements of Rp, with their image in Sp4„, 
i.e. with matrices of the form 



X 



Y 



We want to prove that 

J pe{r, (f), $,)dr = 0, for ah l<p<i , 



Rj,{F)\Rp{A) 

which, by (2.13) means that 

(2.35) J J E^{vr,<j))el/h{v)r)Mv)dvdr = . 

Rp(F)\RpW Ni{F)\Ne{A) 

As in the previous case, it is convenient to conjugate vr in (2.35) by the Weyl 
element 

/ \ 

hn-e 

hn-e 



V 
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We get matrices of the form 



^Ip X B 
L Z A C B' 



(2.36) 



Z* 

V L' Ij 

where z G ^2n-^- Note that 

(2.37) J>(u) = {L2n-l,A2n-t,B'2n-i,',C2n-l,l) 

2n-i-l 

Denote by U' the group of matrices of the form (2.36), with L,X,Y being 
zero and Z = l2n-t- Denote by C the subgroup of matrices of the form (2.36) 
which are lower triangular. Finally, we identify Z2n-i with the subgroup of 
matrices of the form (2.36) where A, B, C, X, Y, and L are all zero. Put, for 
V G Ni{A), 

JeiPvp-') = je{v) 



The integral (2.35) becomes 



(2.38) 



/ / / / 



,(A) Cf\C^ U'p\U' 



El (v!xzf3r, (l))9^ ^{j£{u{x)r)ip£{z)du'dxdzdr. 



By definition. 



J2 io^,i{^,Q,0;Q)ji{u'x)r)^{0,t) . 



By the formulae of uj^^^, it is easy to see that for fixed r/, x and r, the function 

u'^ Yl ^Miri,OAO)jiiu'x)r)aO,t) 
teF^-p 
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is leit-Up invariant. Now it is easy to see that 



teF^-p 



where, as in the previous case, rj^^^ lies in Cp and is such that, in the notation 



of (2.36), L 







. After interchanging summation and integration, we 



changed variable u' i-^ r]^^^ ^u'r]^^\ Substituting this in (2.38), we obtained 

/ III 

Rp{F)\Rp{A) Z2r,-dF)\Z2„_e{A) C'j,\C^ U'p\U'^ 

■ Ei(u'xzPr,(p) LU^^£{ji{u'x)r)^{Q,t) ■ 'ipi{z)du'dxdzdr . 

teF^-p 

Here C is the subgroup of matrices in C such that L2n-e = (in the notation 
of (2.36). Let be the subgroup of matrices in £,, such that all rows of L 
are zero except for the last row. Note that for r G Rp{A) and t G F^~p, 

Thus, "conjugating r back" in (2.39), we get 
(2.40) 

/ / / / 

£(0) Z2„_^(F)\Z2„_^(A) C'j,\C^ Ue-p{F)Ue-p{A) 
A 

■ Ei{u'xza^^^f5,(t)) ^ uj^^i{ji{ux^^^))i{{),t) ■ ^i{z)du' dxdzda^^^ . 

t^F^-P 

Take ^ of the form where G S'(Af) and ^2 G S{A^-''). Then, in (2.40), 
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Thus, (2.40) becomes 

(2.41) I a(a) III 

£(0) Z2r,-dF)\Z2n-e{A) C'j,\C' Ue-j,{F)\Ue-j,{A) 

A ^ 

■ Ei{uxza^'^^P,4>)9^^^_p{ji„j,{u))i)e_p{uz)dudxdzda^^^ . 

Now we are exactly at the same situation as in (2.24). We use a sequence 
of Fourier expansions on Ei , as in the previous case. Note that when we com- 
plete uz to a matrix in N£_p, by inserting elements in the zero, superdiagonal 
coordinates, then ji-p{u) remains unchanged. Therefore, we finally get 



(2-42) E / / 



■ Ei{vjxl3,<p)e^j,_p{je_p{v))il;i_p{v)^i{j{x))dvdx , 
where for x G jCa, we write, as before, x = a^^^ -u', with u' G C^, and j(x) = a. 

Also, for 7 G GLp(F), 7 = Iin-2p I ■ We record the identity that 

V 7*7 

we proved (for ^ = ^i®$2) 

(2.43) j J Ei{vr,(l))el/jeiv)r)Mv)dvdr 

Rp(F)\Rp(A) Ne(F)\Ne{A) 

= E 

■ Ei{v^x/3, (j))9^^^^_p{ji-p{v))tpe_p{v)^i{j{x))dvdx 

or, in the notation (2.13), 
(2.44) 

/ Pe{r,4',£,i^^2)dr = ^ pi-p{^x, P(p,^2)^i{j{x))dx . 

RAF)\R,W jGZ,iF)\GL,iF) 4 

By our assumption pk{h, (p, ^) = 0, for 1 < < i. Note that in po{l) = Po{l, (f)) 
"there are no ^ and no theta series." This is simply the Whittaker coefficient of 
Ei{-,<p), which is zero (Proposition 9). Thus (2.44) implies that the constant 
terms of p£ along the unipotent radicals Rp are all zero. This completes the 
proof in case G = Sp4„. □ 
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3. Corollaries and conjectures. We keep the notation of the previous 
sections. The first step of each of the towers (2.1), (2.2), (2.3), and (2.15) 
is clearly trivial, as follows from Proposition 9(2). In the first two towers, 
(^2n-iiT) (resp. o"2n(T)) is just the restriction of Ei{-,(f>) to H2n-i{^) (resp. 
H2n{^)) and is hence nontrivial. In the last two towers, (T2n-i(T) (resp. CF2n{T)) 
is easily seen to be nonzero for some choice of ip. Thus, from Theorem 8, we 
conclude 

Theorem 10. There is a natural number in, o,nd a choice of in the 
last two cases, such that 



(2.45) in < < 



' 2n — 1, case (2.1) 

2n, case (2.2) 

2n - 1, case (2.3) ' 

_ 2n, case (2.15) 



(^k{T) = 0, for k < in, and o"^„(t) is a nontrivial cuspidal representation of 

We have the following^*) 
Conjecture 1. 

(2.46) in = n; 
i. e. 

S02n+i, case (2.1 

(2.47) He^ 



S02n, case (2.2) 
Sp2n> case (2.3) 
SP2„, case (2.15) 



Proposition 11. cri^{T) is generic in the sense that it admits nontrivial 
Whittaker coefficients. 

Proof. Since cre„{T) is a nontrivial cuspidal representation, we can write 
it as a direct sum of irreducible, automorphic, cuspidal representations. Pick 
a summand a. Then 



(2.48) J ip{h)pe^{h)dh^O 



HeJF)\H(J 



Added in proof. See the footnote, right after Theorem 8. Moreover, we can now also prove 
that (Tfe(T) = for A; < n in the remaining cases. This will appear in a work under preparation. Thus, 
Conjecture 1 is now proved. 
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for cusp forms (p, in the space of a. As mentioned in (2.16), the integral (2.48) 
is the residue at s = 1 of a Rankin- Selberg integral for Hi^ x GL„, where 
m = 2n, in cases (2.1)— (2.3) and m = 2n + 1, in case (2.15). This integral 
represents (after a normalization) the standard partial L-function L'^{a^T, s). 
(In case i^^ = Sp2kJ the L-function depends on i/j.) However the Rankin- 
Selberg integral above is nonzero, if and only if a is generic. This is seen from 
its Euler product expansion (see [G-PS],[G], [So] and [G-R-S3]). In particular, 
it follows from (2.48) that a is generic. This implies that a^^ (r) is generic. □ 

Proposition 12. Let 1 < k < Let a be an irreducible, automorphic, 
cuspidal, generic representation of Hk{A). Then L^{(J®t,s) is holomorphic 
at s = 1. 

Proof. By assumption, we have 

(2.49) J (p{h)piJlijdh = 

Hk{F)\HkiA) 

for all cusp forms if in the space of cr. As in the proof of Proposition 11, the 
integral (2.49) is the residue at s = 1 of a Rankin-Selberg integral 

(2.50) J if{h)Pk,s{h)dh 

Hk(F)\Hk(A) 

which represents the standard partial L-function [a^T, s). In cases (2.1) 
and (2.2) (see (2.11)), 

(2.51) Pk,s{h) = PkAh,^)= J Eivh,fSAMy)dv 

Nk{F)\Nk{A) 

and in cases (2.3) and (2.15) (see (2.13), (2.14)), 

(2.52) Pk,s{h) = PkAh,<l>,0= I Eivh,ffAOikiMv)h)Mv)dv . 

Nk(F)\Nk{A) 

For decomposable data, the integral (2.50) equals an Euler product of the form 

(2.53) l[A{W,,P^A-^'(^^^^') ' 

where 5 is a finite set of places, containing those at infinity, outside which the 
above data is unramified. A{Wu, P^s) "local integrals" at the places 

of S. Wn is a Whittaker function in a prescribed Whittaker model of a^,, and 
P^ g is a corresponding local object obtained from Pk,si depending on (resp. 
{4>i/,Ci^))- Thus the product (2.53) is holomorphic at s = 1 for all data at S. 
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We can choose data at S (i.e. Wu, 4>v, iv) such that ^(VFj/, Pj^ g) holomorphic 
and nonzero at a neighbourhood of s = 1 (see [So], [Sol], [G-R-S3]). 

We conclude that L^{a®T, s) is holomorphic at s = 1. (Recall, again, that 
for Hk = Sp2k this L-function depends on tp.) □ 

We will prove in the next chapter one part of Conjecture 1, which is 

Theorem 13. In case (2.3), 

in>n; 

i.e. for an irreducible, automorphic, cuspidal representation r o/GL2n(A), such 
that 

L^(t, si, 1/2) 

and 

L^{t, A^, s) has a pole at s = 1 , 

we have 

a^ir) = 0, for 1 < < n . 

Combining this and Proposition 12, we get one of the main results of this 
paper. 

Theorem 14. Let a^r be an irreducible, automorphic, cuspidal, 
generic representation o/Sp2fc(A) x GL2n(A), such that 1 < k < n, 

L^{T,st,l/2)j^0 

and 

{t, , s) has a pole at s = 1 . 

Then L^(cr0r, s) is holomorphic at s = 1. 

Finally, assume that in is given by Conjecture 1. Let a be an irreducible 
summand of the cuspidal representation a^^ (r) . As in the proof of Proposition 
11, and as in (2.53), keeping the same notation, we can find data at S, such 
that 

llA{W,,Pi^,)L^ia®T,s) 

has a pole at s = 1. We expect that, for all data, AiWy, P^^ ^) is holomorphic 
at s = 1, so that L^{a®T, s) has a pole at s = 1. We cannot prove this at this 
stage. We make the following stronger conjecture. 



Added in proof . See the footnotes after Theorems 8 and 10. 
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Conjecture 2. The number in is given by Conjecture 1, and cr£^{T) 
is irreducible. Moreover, r is the functorial lift of a^^ (r) from H^^ to GL^ 
{where m = 2n in cases (2.1)-(2.3) and m = 2n + l in case (2.15).) 

Remark 1. Let a be an irreducible, automorphic, cuspidal generic repre- 
sentation of H£^{A). Let T be its Langlands functorial lift to GLm(A) (m as 
above). Assume that r is cuspidal. Since L'^(cj0r, s)(= {t^t, s)) has a 
pole at s = 1, we may apply our theory and find, by definition, that a is a 
summand of <t^„(t). Thus cj£„(r) contains all generic a which lift to r. Conjec- 
ture 2 implies that there is a unique generic a which lifts to r (i.e. a = ct^^^t) 
is the unique generic member of its L-packet.) 

Remark 2. Case (2.3) is a remarkable generalization of Waldspurger's re- 
sult [W] on the thcta correspondence between irreducible, automorphic, cus- 
pidal representations r of PGL2(A) such that L(r, ^) ^ and -(/'-generic rep- 
resentations of SL2(A). Our generalization is to r - on GL2n(A) such that 
L^{t,A^, s) has a pole at s = 1 (this is automatic for n = 1 and r with trivial 
central character) and L(r, st, 5) 7^ 0. To r we associate (t„(t) on Sp2„(A). 



3. Proof of vanishing of C7fc(r), for A; < n, in Case G = Sp, 



'4n 



In this chapter, we prove Theorem 13. The main part of the proof is a 

local statement about the disjointness of Sp2„ x Sp2„-invariant functionals on 
representations of G and certain eigenfunctionals with respect to a subgroup 
of Nk- For this chapter, we let G = Sp4„, H = Sp2„ x Sp2ji, embedded in G 
through i in (1.7). We fix 1 < A; < n. 

1. A preliminary reduction. Let r be an irreducible, automorphic, cus- 
pidal (self-dual) representation of GL2n(A), such that L^{T,st,^) / and 
L^{t, h?, s) has a pole at s = 1. Consider the following subgroup, N^^\ of Nj^, 

I z u * * * \ 

C 1 y * ^ 

(3.1) TVW = <^ ^; = /2fe * G G z G Z2„_(fc+i) \ , 

V z*) 

and its character 

(3.2) Xfe(v) = V'fc(^)V'(y) = V'(^12 + 2;23H |-2;2n-fc-2,2n-fc-l+?^2n-fe-l)^(y) • 



Lemma 15. We have Okij) = 0, if and only if 
(3.3) j Ei{v,4>)xk{v)dv = 

ArW(F)\Ar(fc)(A) 
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Proof. The elements of (Tfe(r) are given by Pk{h, 4>,^) in (2.13). iTfe(T) 
if and only if 0, ^) = (for all (j) and ^). We have 



0, 



(3.4) Pkil,(t>,0= J E,iv,(t>)J2 

Nk{F)\Nk{A) 

Let 



(3.5) Nk,i 



V 



/ hn-k-l 



(3.6) Nk,2 = 



a = 



* 


* 







y 


* 








* 


Ik 


e' 


* 




1 


* 








1 





a 




h 






h 



V 



'2n-fc-l 



Then A^fe = A^fc^i x: Nk^2, and we can rewrite (3.4), using the notation in (3.5) 
and (3.6), as 



^i),k{jk{a*))£,{x + e)'ipkiv)ip{y)dvda 
= y" j Ei{va*,(j))uj^^kijkia*))^{e)tpkiv)tp{y)dvda 

= J J Ei(va*,4>)'il^{2ewk^a)tpkiv)i'{y)^{e)dvda . 



Here Wk = 



. Consider v in the last integral, and take it in the 



1 



form (3.5). Write 
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/ hn-k-l 



where v' G TV^^) and e = 



1 e 
4 



h el 
1 



V 



(3.7) 



ea 



hn-k-l 

\ 



. We have 



V 



a e . 



( hn-k-l 

1 2ewk^a 
Ik 
Ik 
1 

hn-k-l I 

Using this in the last integral, and changing variable y ^ y — 2ewk^a, we obtain 
Pfc(l>^>0= J J J Ei{v'a*e,(f))Xk{v')^{e)dv'dade . 

Thus, for given cf), pk{l,4>,i) = 0, for all ^ G S{K^), if and only if 

j j Ei{v'a*e,(p)Xk{v')dv'da = 0, for all e G A*^ . 

Thus, Pfc(l, = 0) for all 4> and all ^, if and only if 

(3.8) J J Ei{va*,(l))xk{v)dvda = 0, for all . 

Ffc\Afc A?"W(F)\Ar(fc)(A) 

Consider in (3.8) a right translation of Ei by e, where e G F*^. Using (3.7), 
and changing variable y i— > y + 2ewk^a, and then eve~^, recalling that Ei 
is left G{F) invariant, we obtain from (3.8) 

(3.9) J J Ei{va*,^)xk{v)'il){2ewka)dvda 

Fk\Ak iV('=)(F)\Ar('=)(A) 

which is a general Fourier coefficient of the following function on F^\A^ 



(3.10) 



J Ei{va*,4>)xkiv)dv . 



NW (F)\Ar(fe)(A) 

Thus the integral (3.8) is identically zero (for all 0), if and only if the integral 
(3.9) is identically zero, for all and all e G F'^, which is equivalent to the 
function (3.10) being identically zero, for all (f). This completes the proof of 
the lemma. □ 
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Our aim now is to show (3.3), for k < n. 

2. H -invariant functionals and {N^^\ xk-)-P'WC'nfrmctionals are disjoint. 
We formulate the local result which is the heart of the proof of Theorem 13. 
In this section, F is a local non-archimedean field. 

Theorem 16. For < k < n, the Jacquet module J^(k) ^^^(Ind'^ ^ 1) is 

zero. 

Note that N^^^ is the standard maximal unipotent subgroup of G, and xo 
is its standard nondegenerate character. As a corollary, we get 

Theorem 17. Let tt be an irreducible, admissible representation of 
Sp4„(F). Assume that {the space of) tt admits nontrivial H-invariant func- 
tionals. Then, for < k < n, J^ik) .^^{t^) = 0, i.e. tt has no nontrivial 
{N^^\xk)-^'i'9^'nfunctionals. 

The reason is that vr admits nontrivial i?-invariant functionals, if and only 
if vf admits nontrivial iJ-invariant functionals (soon to be explained) and this 
happens if and only if vf embeds in Ind^ 1 = C°° {H\G) , which is the same as 
the existence of a surjection 

llid'- 'l 1 > ^ ^ TT 

and by the exactness of Jacquet functors and Theorem 16, we get J'j^(k),x^. (vr) 
= 0. Let us explain why tt admits nontrivial iJ-invariant functionals if and 
only if TT does. By [MVW, p. 91], vf = tt^ where ir^ is the composition of 

TT with conjugation by S* = ^"^^^ ^ ^ G'Sp4„(F), such that S is not a 

square in F. It is clear that conjugation by S* preserves H (see (1.7)). Thus, 

if TT acts on the space and £ is a (vr, i7)-invariant functional on T^, then 
i{TT^{h)^) = l{TT{h^*)0 = ior heH and ^eV^ = V^6, so that i serves as 
an iJ-invariant functional for vr'' as well. 

The proof of Theorem 16 will be given in Section 4 of this chapter. 

3. Theorem 16 implies Theorem 13. We return to the global setup. In 
this section, F is a number field and r is as in Section 1. Consider the residue 
representation -Ei(r) in the space {Ei{g,(f)) = Kes E{g, ffg)}- It lies in the 

s=l ' 

residual spectrum of L^{G{F)\G{A)). Write -E'i(r) = ©tt,, a direct sum of 
irreducible representations (realized in concrete subspaces T^-J- Let k < n. 
Denote the Fourier coefficient (3.3) by VF^ = Wk{Ei{-,(/))). We want to show 
that Wk is zero on each summand tt^. By Theorem 2 and Corollary 3, the pe- 
riod along H is nontrivial on £'i(r). Therefore, there is a summand TTig, such 
that the period along H is nontrivial on (the space of) TTjg. Write TTi^ ~ ^'^iQ,u, 
a tensor product of local representations. Pick a decomposable vector (S)/^, so 
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that the period is nontrivial on its corresponding automorphic form in Kri^- 
Let iS be a finite set of places such that for v ^ S, is the (prechosen) 
unramified vector of TTig^u. Fix any ^ S, and consider the restriction of 
the period along H on the subspace of , which corresponds to decompos- 
able vectors ®fu, where, for v ^ vq-, fv = f^-, and f^^ varies in the space 
of -KiQ^iiQ. This defines a nontrivial H {Fy^)-\mrax\sj[i\, functional on -Ki^^vo, and 
hence, by Theorem 17, J^(,k) {'^io,vo) = 0. This implies that Wk is triv- 
ial on TTig; otherwise, using the same reasoning as above, Wk defines a non- 

(k) 

trivial {K;' 

) XA:,i^o)"^iS^^f^^'^*i°^^l °^ ^io.i^o' that is a nontrivial clement of 
^7 (fe) i'^iQ,uo), which is a contradiction. To complete the proof of Theorem 

13 (using Theorem 16), it remains to prove that Wk is trivial on all summands 
TTj. Indeed, let tTj, i 7^ zq, be any other summand. It is clear that TTj and TTig 
are locally isomorphic at almost all places. (For almost all i^, TTj 1/ and TTjQ ;/ are 
isomorphic to the unique unramified constituent of Indp" Ti,^\ det -l^/^.) What 
we just proved implies, for almost all u, 

and, in particular, Wk is trivial on tTj. 

It now remains to prove Theorem 16. 

4. Proof of Theorem 16. We return to the notation of Section 2. F is a 
local non- archimcdcan field. G = Sp^^{F), A^^^) = A^(^)(F), etc. (0 < A; < n IS 
fixed). Let T denote the diagonal subgroup of G and W, the Weyl group of G. 

We prove Theorem 16 by standard Bruhat theory. For this, we have to 
describe the double cosets H\G/N^'^\ and show that for all g E G, 

(3.11) Xk\g-'HgnN^'^^l . 

We start by realizing H\G inside G. Let 

'In 



and define 

^{g) = e^e"^ = sge: ■ 

Note that 6 is of order two, and that 9 preserves root subgroups. The central- 
izer of e in G is H, i.e. 0{g) = g, if and only g £ H. Let 

Y = {g-'e{g) \geG}. 

Then 

Y ^ H\G , 
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by 

The natural right action of G on H\G, is translated, via / to a twisted conju- 
gation of G on y 

y ■ 9 = g'^y^ig) ■ 

As a first step, we show, after [Sp] (see also [J-R2, Lemma 2]). 
Proposition 18. Each y can be written in the form 

(3.12) y = u''^wa9{u) , 

where u € N^^\ w G W, a €iT, such that 

(3.13) e{wa) = (wa)-^ . 

{W is chosen to be generated by the simple reflection matrices.) 

Proof. Since d{N^^^) = N^^\ we can write the Bruhat decomposition of y 
in the form 

(3.14) y = Ui^wae{u2) , Ui € N^^^ ,w eW,aeT . 
By definition of Y, its elements satisfy 

(3.15) e{y) = y-', y eY . 
Applying (3.15) to (3.14), we get 

(3.16) e{u^^)e{wa)u2 = e{u^^)iwa)-^ui . 

By the uniqueness property of Bruhat decomposition, and the fact that 

e(NG{T)/T^ =Ng{T)/T , 

we get, from (3.16) 

6{wa) = {wa)~^ , 
which is (3.13). By definition of 6, we have 

(3.17) e{w) = t-w , 

where t is diagonal, with ±1 along the diagonal. Prom (3.13), we get 

6{w)a = w~^{wa~^w''^) ; 

hence 

(3.18) eiw) =t' -w-^ , 

where t' is diagonal with ±1 along the diagonal. We conclude that 

(3.19) w'^ = 6 , 
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where 6 is diagonal, such that 5^ = /. (i.e. w is of order two in Ng{T)/T). Note 
that (3.19) impUes, that when we write w as a permutation matrix in GL4„(F), 
up to signs, then Wij 7^ if and only if wji 7^ (m^- = ±Wji = il). Note that 
since w is symplcctic, we have Wk^i 7^ 0, if and only if W4n+i-fc,4n+i-i 7^ 0- 
Consider, for a Weyl element 7, 



N+ = {ue iV(°) I 7«7-i G iV(°)} 
N- = {u€ Ar(°) I 7«7-i e Ari°^} . 

(ivl°^ is the opposite to iV(°).) Prom (3.19), it is clear that 

(3.20) N+ = N+_, and = N-_, . 
It is also clear that 

(3.21) ^(iV±) = 7V± . 

This follows from (3.17), (3.18), and the definition of 6. We may assume that 
U2, in (3.14), lies in -/Vj_i. Write, in (3.14), ui = vfv^, where vf € N~^_-i and 
G Writing (3.15) again, 

(3.22) e{v^)-^e{vi)-^e{wa)u2 = 0{u2^){wa)-^vtv^ . 

Since {wa)~^Vi{wa) G a~^w~^N^_iwa G Ar(°), we conclude, from (3.22) and 
the uniqueness in the Bruhat decomposition that U2 =Vi. Thus 

y={v^r\{vtr'-wa)9{v^) . 

This means that the A'^^'^-* -orbit of y is the same as that of {vi)~^ ■ wa, and so 
we may assume that y = {vf)~^ ■ wa. Using (3.15) again, we get 

e{vf)-^6{wa) = (wa)-^ ■ . 

Applying 6, and using (3.16), we get 

(3.23) {v+y^ = {wa)e{v+){way'^ . 
Consider the map 

X{u) = wad{u){wa)~^ . 

It is clear, from (3.13), (3.20) and (3.21), that A defines an automorphism of 
order two of N;^_j_. By (3.23), X{vf) = (v^)"^ Since 7V+_i is nilpotent, there 
is -y G N'^-i, such that 

Vi = X{v~^) ■ V 
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and so 



y = iy'^) ■ wa = v ^X{v) ■ wa 
= v^^wa9{v){wa)~^ ■ wa = ■ wa ■ 6{v) . 

This proves Proposition 18. □ 




2n-fe-l 

u 



'2n-fe-l 



u lies in the standard > 
maximal unipotent subgroup 

0fSp2fe+2(^) 



Clearly 



[/(fe) normalizes AT^*^) and for u G U^''\ v G N^'^\ we have 

(3.24) Xkiuvu-^) = Xk{v) . 

Note that U^''^ D N^'^^ is the center of U^^h From Proposition 18, we have, of 
course, that the iV^'^^-orbits in Y have representatives of the form 

(3.25) u-^ ■ wa ■ e{u) , 

where u G U^^^ and wa as in (3.13). 

Now, in order to prove (3.11), we have to show that is nontrivial on 
the stabilizer, in N^'^\ of elements of the form (3.25). An element v G N^''^ is 
in the stabilizer of (3.25) if and only if 

■ {u~^wad{u))6{v) = u~^wa9(u) ; 

i.e. 

{uvu'^)~^wa9{uvu~^) = wa . 

By (3.24), it is enough to assume that u = / in (3.25). Thus, we have to solve 

■ wa ■ 9{v) = wa , v e N^'^^ . 

We find it more convenient to replace v by 9(v). Of course, this is permissible. 
The last equation transforms to 

(3.26) w{ava^^)w^^ = eve . 

Thus, if V is in the stabilizer of wa, w must "preserve the root structure" of v. 

Let us call wa, satisfying (3.13), nonrelevant, if equation (3.26) admits 
solutions V in N^''\ such that Xf,(v) ^ 1. Otherwise, call wa relevant. So, in 
order to prove (3.11), we must show that all wa satisfying (3.13) are nonrele- 
vant, if < n. 
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Let Lfc be the set of roots "inside A^C^)". For a root a, and t € F denote 
by Xa{t) the corresponding standard unipotent matrix. Let C be the 
subset of roots a, such that ^k{xa{t)) ^ 1- The following two lemmas are 
useful. 

Lemma 19. Let a G A^. Assume that (3 = w{a) E \ A^. Then wa 
is nonrelevant. 

Proof. It is similar to [J-R2, Prop. 2]. Let 

(3.27) V = Xa{t)xp{s)xa+p{e) 

where Xa+p{e) = 1, in case a + (3 is not root. We will show that there are 
t,s,e, such that v solves (3.26) and ^k{v) 7^ 1. We have 

(3.28) wxa{t)w~^ = x/s{ct) , c = ±l. 
By (3.19), 

(3.29) wxp{s)w~'^ = Xaic's) , c' = ±1 , 
so that, 

Xa{cct) = w'^Xa{t)w~'^ = Xa{(x{w'^)t) . 

We conclude, 

(3.30) a{w^) = cc' . 
Similarly, if a + /? is a root, then 

(3.31) WXa+l3ie)w~^ = Xa+i3{c"e) , c" = ±1 . 
Using (in our case, since a and /3 have the same length) 

[Xa{t),Xi3{s)] =Xa+/3{dts) , 

where c? = 1, 2 (depending on /?), we get 

Xa+f3{c"dts) = [Xp{ct), Xaic's)] = [Xaic' s) , Xp{ct)]~'^ = Xa+pidc' cts)~^ 
= Xa+pi-c'cdts) . 

Thus 

(3.32) c" = -cc' = -a{w'^) . 

Now substitute (3.27) in (3.26) and use (3.28), (3.29) and (3.31). We then 

have to solve 

(3.33) 

Xi3{ca{a)t)xa{c (3{a)s)xa+i3{c" afj{a)e) = Xa{a{s)t)xp{P{e)s)xa+p{aP{e)e) . 
Write the right-hand side of (3.33) as 

Xi3{l3{e)s)xaia{e)t)xa+f3iaP{e){e + dts)) . 
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Thus, we must solve 

(3.34) ca{a)t = l3{e)s , 

(3.35) c'l3{a)s = a{e)t , 

and if a + /? is a root, also 

(3.36) c"aP{a)e = al3{e){e + dts) . 



To solve (3.34) and (3.35), we must have 

ca(a) a(e) 

i.e. 

(3.37) cc'aPia) = a/3(e) . 

We have, 

/3{ae) = wa{ae) = a{wa£ur^) = a{e)a{ewaew~^) 

= a{e)a{a~^w~'^) = a{ea~^)a{w~'^) = a{ea~^)cc' . 

We used (3.13), (3.19) and (3.30); (3.37) now follows (Recall that c,c' = ±1.) 
Now solve (3.36) 

{c"a(3{a) — Q.p{e))e = af3{e)dts . 

Thus, we only have to make sure that (/'a(3{a) — af3{e) ^ 0. Indeed, by (3.32) 
and (3.37), 

c"a/3(a) - al3{e) = -cc'aPia) - afi{e) = -2al5{e) / . 
Thus, choose, s = e = Then v in (3.27) solves (3.26) and 

x^{v) = m # 1 . 

This proves Lemma 19. □ 
Lemma 20. For w and a satisfying (3.13), 

Wi^4n+l-i = . 

That is, w has zero along the second main diagonal. 

Proof. Let i be such that Wi,4n+i-i 0. We may assume that i < 2n 
and Wi^^n+i-i = 1- Then, clearly, W4n+i-i,i = ~1- Let us concentrate on 
the SL2-subgToup of G embedded in the coordinates {i,i), (i,4n + 1 — i) , 
(4n + 1 — i,i) and (4n + 1 — i, 4n + 1 — i, i) and equate these coordinates only 
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in equation (3.13), ewae = a ^. Write a = diag(ai, . . . , a2n, o,2n' ■ 
Since a^n+i-i = ^® 

(note that e has no effect here), which is impossible. 
To prove (3.11), we first show 
Lemma 21. Ifwa is relevant, then 

Wij = for all 1 < i, j < 2n — k 

hence {since w is a Weyl matrix) w has the form 

2n-k 
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• ,ar'). 



2n-k< 



W = 



••• 

* 



••■ 

••• o/ 

2n-k 



>2n-k 



Proof. Assume that wn = 1. Then 

1 

w = \ w' 



□ 



where w' is a Weyl matrix in Sp4„_2(-F). Consider the simple root ai, such 
that 

/I t \ 
1 

1 -t 

\ 1 / 

Then ai G and w(ai) G Lk\Ak, unless w has the form 



/I 



w 



w 



1/ 



862 



DAVID GINZBURG, STEPHEN RALLIS, AND DAVID SOUDRY 



Consider the root Q!2, such that 

/I 



■^oti (^) 



1 i 
1 



1 -t 
1 



V 



1/ 



Then G and wia-i) G Lfc\Afc, unless w has the form 

w = 



^3, 



etc. By Lemma 19, w is nonrelevant, when we get to the i*^ simple root 
of GL2„_fe, CKi, and ^^(ai) G Lk\Ak (clearly, w{ai) G L^), 1 < i < 2n - n. 
Otherwise, 

/ hn-k-l \ 
1 



V 



with w - a Weyl matrix in Sp2/j(-F). For such it;, equation (3.13) implies, for 
a = diag (oi, . . . , a2„, ' • • • ' «r^)' 



of = 1 , i = 1, . . . ,2n — k . 



Thus (3.26) is solved with v = Xr){y) = 



I hn-k-l 



V 



1 y 
hk 
1 



hn-k-l I 



Note that Xj.(i;) = ■;/;(?/) ^ 1. Thus, ww = 0. Now, note that 
W2n-k,j = j = l,...,2n-k 

(and hence, 

Wi,2n-k = i = 1, . . . , 2n - A;) . 

Indeed, if, say, W2n-k,j = 1 for j < 2n — k. Then, by (3.19) (and the following 
remark) w{r)) G Lfc\Afe, or w{r]) = ij. In the first case, 

1 ±y 

Xw{r)){y) = In-2j 

1 

V ij-ij 
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Using Lemma 19, we see that wa is nonrelevant. If w{r]) = ij, use the argument 
above, which shows that a2„_^ = 1 and hence Xr,{y) solves (3.26), so that wa 
is again nonrelevant. Now, assume that Wji = 1, for 1 < j < 2n — k. Then, 
wij 7^ 0. For simplicity, we assume that wij = 1 {wji,wij = ±1 are allowed, 
in general). It is easy to see that wlaj) £ Lfc\A/j, unless w{aj) = ai, which 
takes place if and only if 7^ 0. Again, we assume for simplicity that 

Wj+i^2 = W2,j+i = 1 (recall (3.19)). Now consider w{aj-^i). Again, w{aj+i) G 
Ljfc\Afc, unless w^aj^i) = a^- We continue in this manner, and get that wa is 
nonrelevant, if we find j' such that j + j' < 2n — /c — 1 and w{o.jj^,y~) € Lfc\Ajt 
(and then use Lemma 19). Otherwise, the upper left (2n — k) x {2n — k) block 
of w has the form (up to signs) 



2n-k 



2n-k 
i \ 













1 









Now it is clear that w{a2n-k-i) G ^-^d by Lemma 19, wa is nonrelevant. 

We continue in the same manner, row by row, in the upper left {2n—k) x {2n—k) 
block, and get the lemma. □ 

Lemma 22. If wa is relevant, then 

0, l<i<2n-k , 2n + A;+l<j<4n 



w, 



and hence {by Lemma 21 and (3.19)) w has the form 

2n-k 



2n-k 



(3.38) 



w = 






Vo 





















0/ 



>2n-fe 



>2n-k 
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Proof. By Lemma 19, we know that wi,4n = 0. Assume that wi^^n+i-j 
7^ 0, for 2 < j < 2n - k. Note that by (3.19), w^n+i-j,! + 0. It is clear 
that w{a.j-\) G L^, and w{aj-\) G Lis\Ai^, unless W2,4n+2-j / (and hence 
W/^n+2-j,2 7^ 0) in which case w(aj^i) = a\. In the first case, it follows from 
Lemma 19 that wa is nonrelevant. In the second case, we have w{oLj-2) € L}^., 
and ■u;(Q!j_2) G Lk\Ak, unless W3^4n+3-j (and hence W4n+3-j,3 0), in 
which case w{aj-2) = "2, and so on. If at a certain stage we find a simple 
root ctj-j', such that w{aj_ji) £ Lk\Ak, then we are done, by Lemma 19. 
Otherwise the upper-right (2n — k) x (2n — k) corner of w has the form 



/0---±l 



w = 



±1 



V 



\ 



±1 



/ 



and j is even (Lemma 20). Consider the coordinates of w in positions 
(|,4ra - i), (i,4ra - i + l), (i + l,4n - i), (i + l,4n- I + l) and the corre- 
sponding Sp4-Weyl submatrix Wj of w 



Wi 



( 








b 


o\ 













c 




















-6-1 





0/ 



b,c = ±l . 



Put Oj = d, fflj 1 1 = e. Then, in 6{w) = ewe, wj cither remains unchanged, or 

2 2 ' 

it is multiplied by —1. The second case takes place only if j = 2n, and then 
A; = 0. 

Denote the submatrix of 0{w), which comes in place of Wj by 

/ b' 0\ 
c' 

-c' 

V -6' y 

Now examine condition (3.13) in the above coordinates only. Then, we 
must have 

d = —bc'e . 



((6V) = ±(6,c) = ±(±l,±l)) . 



Clearly 'w{aj/2) 
Indeed, we have 



a 



j/2- Now equation (3.26) is solved with v 



it). 



waxaj {t)a ^ = wxaj {—bc't)'W ^ = (cc't) 
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while 

exaj it)e = Xaj ("i (e)i) • 
We have ai{e) = —1, if and only if j = 2n, and similarly c/ = — c, if and 

2 

only if j = 2n. Otherwise ajfe) = 1 and c' = c. Since = 1, (t) solves 

equation (3.26) and since ^ki^'a^ (t)) = i/j{t), we find that wa is nonrelevant. 

We continue in this manner, row by row, in the upper right (2n — k)x (2n — k) 
block, and get the lemma. □ 

So far, we did not use the fact that A; < tt,. To conclude the proof of (3.11), 
and hence of Theorem 13, we note that if k < n, the matrix w of type (3.38) 
cannot be invertible, given that it is a Weyl matrix in Sp4„(F). 

Tel Aviv University, Tel Aviv, Israel (D.G.) and (D.S.) 
E-mail addresses: ginzburg@math.tau.ac.il and soudry@math.tau.ac.iI 

The Ohio State University, Columbus, OH (S.R.) 
E-mail address: haarQmath.ohio-state.edu 



References 

[Al] J. Arthur, A trace formula for reductive groups. I. Terms associated to classes in 

G(Q), Duke Math. J. 45 (1978), 911 952. 

[A2] , A trace formula for reductive groups. II. Applications of a truncation op- 
erator, Compositio Math. 40 (1980), 87-121. 

[B-G] D. Blimp ami D. Ginzburg, Symmetric square L-functions on GL(r), Ann. of Math. 
136 (1992), 137-205. 

[F-J] S. Friedberg and H. Jacquet, Linear periods, J reine angew. Math. 443 (1993), 

91-139. 

[G-PS] S. Gelbart and I. Piatetski-Shapiro, L-functions for G x GL(n), Lecture Notes in 

Math. 1254, 53-136, Springer- Verlag, New York, 1985. 
[G] D. Ginzburg, L-functions for S0„ x GLfc, J. reine angew. Math. 405 (1990), 156- 

180. 

[G-R-Sl] D. Ginzburh. S. Rallis. and D. Soudry, A new construction of the inverse Shimura 

correspondence, IMRN, no. 7 (1997), 349 357. 
[G-R-S2] , Self-dual automorphic modules and construction of a backward lifting from 

GL„ to classical groups, IMRN, no. 14 (1997), 687-701. 
[G-R-S3] , L-functions for symplectic groups, Bull. Soc. Math. France 126 (1998), 

181-244. 

[G-R-S4] , A tower of theta correspondences for G2, Duke Math. J. 88 (1997), 537- 

624. 

[G-R-S5] , On a correspondence between cuspidal representations of GL2n and Sp2„, 

J. A.M.S. 12 (1999), 849-907. 

[G-R-S6] , Lifting cusp forms on GL2n to Sp2„: the unramifled correspondence, Duke 

Math. J., to appear. 

[J-Rl] H. Jacquet and S. Rallis, Symplectic periods, J. reine angew. Math. 423 (1992), 
175-197. 

[J-R2] , Kloosterman integrals for skew symmetric matrices, Pacific J. Math. 154 

(1992), 265-283. 

[J-Sl] H. Jacquet and J. Shalika, Exterior square L-functions, in Automorphic Forms, 
Shimura varieties and L-functions 2, 143-226 (L. Clozel and J. Milne, eds.), 1990. 

[J-S2] , On Eulcr products and the classification of automorphic representations I, 

Amer. J. Math. 103 (1981), 499-558. 



866 



DAVID GINZBURG, STEPHEN RALLIS, AND DAVID SOUDRY 



[J-S3] H. Jacquet and J. Shalika, On Eulcr products and the classification of autoniorphic 

representations II, Amer. J. Math. 103 (1981), 777-815. 
[M-V-W] C. McEGLiN, M. F. ViGNBRAS, and J.-L. Waldspurger, Correspondences de Howe 

sur un Corps p-Adique, Lecture Notes in Math. 1291, Springer- Verlag, New York, 

1987. 

[M-W] C. McEGLiN and J.-L. Waldspurger, Spectral Decomposition and Eisenstein Series, 

a Paraphrase of the Scripture, Cambridge University Press, Cambridge (1995). 
[PS-R] I. PiATETSKi- Shapiro and S. Rallis, L-functions for classical groups, in Lecture Notes 

in Math. 1254 (1985), 1-52. 
R] S. Rallis, On the Howe duality conjecture, Conipositio Math. 51 (1984), 333-399. 

Shi F. Shahidi, On certain L-functions, Amer. J. Math. 103 (1981), 297-355. 

So] D. SouDRY, Rankin- Sclb erg convolutions for S02^-i-i x GL^: Local theory, Memoirs 

of A.M.S. 500 (1993), 1-100. 
[Sp] T. Springer, Sonic results on algebraic groups with involutions, in Algebraic Croups 

and Related Topics, Adv. Stud, in Math. 6, 323 343, North-Holland. New York, 

1985. 

[T] B. Tamir, On L-functions and intertwining operators for unitary groups, Israel J. 

Math. 73 (1991), 161 188. 
[W] .J.-L. Waldspurcer, Corrcspondance de Sliiinura. ,J. Math. Purcs Appl. 59 (1980), 

1 132. 

[Wt] T. Watanabe, Autoniorphic L-functions for quasi-split unitary groups and a theta 

series lifting, preprint (1996). 



(Received October 13, 1997) 



